-- Logs begin at Mon 2022-10-17 06:24:17 UTC, end at Mon 2022-10-17 07:24:10 UTC. -- Oct 17 06:54:24.100183 dv-cinder-845069-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 06:54:24.109673 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 06:54:24 2022] *** Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: nodename: dv-cinder-845069-5-iscsi Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: machine: x86_64 Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: clock source: unix Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: pcre jit disabled Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: detected number of CPU cores: 4 Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: current working directory: / Oct 17 06:54:24.111692 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: detected binary path: /usr/bin/uwsgi-core Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: your processes number limit is 47680 Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: your memory page size is 4096 bytes Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: detected max file descriptor number: 2048 Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: lock engine: pthread robust mutexes Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: thunder lock: enabled Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 06:54:24.112360 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 06:54:24.151547 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: Python main interpreter initialized at 0x5613468e09c0 Oct 17 06:54:24.151547 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: python threads support enabled Oct 17 06:54:24.151547 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: your server socket listen backlog is limited to 100 connections Oct 17 06:54:24.151547 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: your mercy for graceful operations on workers is 90 seconds Oct 17 06:54:24.151958 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 06:54:24.152036 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: *** Operational MODE: preforking *** Oct 17 06:54:24.152252 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: *** uWSGI is running in multiple interpreter mode *** Oct 17 06:54:24.152252 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: spawned uWSGI master process (pid: 103766) Oct 17 06:54:24.152446 dv-cinder-845069-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 06:54:24.152996 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: spawned uWSGI worker 1 (pid: 103767, cores: 1) Oct 17 06:54:24.153331 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: spawned uWSGI worker 2 (pid: 103768, cores: 1) Oct 17 06:54:24.153605 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 06:54:24.805316 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 06:54:24.814007 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 06:54:25.876368 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 06:54:25.876368 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: from cryptography.utils import int_from_bytes Oct 17 06:54:25.876947 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 06:54:25.876947 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: from cryptography.utils import int_from_bytes Oct 17 06:54:25.892502 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 06:54:25.892502 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: from cryptography.utils import int_from_bytes Oct 17 06:54:25.892959 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 06:54:25.892959 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: from cryptography.utils import int_from_bytes Oct 17 06:54:28.343092 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 06:54:28.343685 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 06:54:28.344033 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 06:54:28.344120 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 06:54:28.344210 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 06:54:28.344291 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 06:54:28.344370 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 06:54:28.344459 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 06:54:28.344545 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 06:54:28.344633 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 06:54:28.344848 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.344978 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.345166 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.345301 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.345483 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.345620 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.345798 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.345936 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.346125 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.346262 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.346434 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.346571 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.346749 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.346889 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347064 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347252 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347409 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347535 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347666 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347794 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.347977 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.348105 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.348297 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-5-iscsi {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.348424 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-5-iscsi {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.348613 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.348742 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.348915 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349050 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349218 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349358 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349530 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349671 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349828 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.349970 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.350150 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.350287 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.350452 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.350587 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.350936 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.351090 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.351435 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.351683 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.351796 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.351989 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.352083 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.352299 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.352420 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.352633 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.352744 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.352936 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353032 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353239 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353346 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353542 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353631 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353846 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.353938 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.354149 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.354257 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.354453 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.354565 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-5-iscsi {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.355509 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-5-iscsi {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.355629 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.355779 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.355950 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.356038 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.356129 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.356341 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.356426 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.356727 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.356823 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357034 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357133 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357336 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357421 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357657 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357784 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.357963 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358080 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358267 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358354 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358589 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358690 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358901 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.358998 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.359251 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.359342 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.359536 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.359651 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.359842 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.359940 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.360143 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.360243 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.360447 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.360532 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.360748 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.360835 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361049 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361146 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361297 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361384 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361584 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361673 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.361886 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362057 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362203 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362290 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362518 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362605 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362768 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.362863 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363016 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363330 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363435 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363651 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363737 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.363954 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364040 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364258 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364353 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364560 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364652 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364858 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.364951 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.365156 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.365249 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.365454 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.365547 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.365754 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.365847 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366053 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366148 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366353 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366439 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366663 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366759 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.366968 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.367055 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.367288 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.367376 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.367597 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.367685 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.367914 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368003 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368221 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368317 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368523 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368609 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368827 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.368913 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.369159 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.369245 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.369459 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.369545 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.369761 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.369907 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.370074 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.370174 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.370400 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.370497 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.370702 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.370788 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371004 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371098 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371327 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371434 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371643 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371731 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.371942 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372027 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372190 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372287 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372486 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372616 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372780 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.372866 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373079 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373179 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373378 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373464 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373678 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373763 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.373976 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374075 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374364 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374567 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374698 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374866 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.374953 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.375175 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.375306 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.375486 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.375591 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.375784 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.375881 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376081 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376175 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376380 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376481 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376679 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376773 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.376977 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377077 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377272 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377366 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377567 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377668 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377880 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.377976 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.378178 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.378289 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.378480 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.378576 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.378775 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.378904 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.379073 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.379168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.379400 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.379497 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.379699 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.379793 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380000 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380094 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380303 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380397 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380602 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380696 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380901 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.380994 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.381198 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.381293 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.381500 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.381595 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.381800 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.381903 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382099 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382194 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382392 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382494 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382691 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382793 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.382994 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383089 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383315 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383420 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383617 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383718 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383913 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.383999 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.384207 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.384292 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.384503 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.384602 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.384798 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.384883 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.385094 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.385186 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.385387 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.385477 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.385679 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.385765 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386016 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386104 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386331 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386428 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386635 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386728 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.386937 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387024 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387255 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387356 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387572 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387718 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387891 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 06:54:28.387977 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.388216 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.388310 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.388541 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.388628 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.388857 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.388996 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.389176 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.389261 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.389501 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.389586 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.389814 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.389910 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.390125 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.390218 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.390434 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.390532 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.390746 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.390844 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.391053 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.391146 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.391384 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.391485 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.391695 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.391849 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392004 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392089 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392314 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392414 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392627 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392737 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.392940 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393038 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393249 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393337 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393562 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393665 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393866 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.393952 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.394175 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.394263 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.394491 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.394580 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.394805 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.394891 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.395114 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.395200 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.395476 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.395567 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.395821 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.395909 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.396137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.396232 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.396462 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.396550 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.396782 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.396867 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.397090 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.397185 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.397397 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.397484 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.397703 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.397831 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398010 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398105 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398340 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398426 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398649 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398734 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.398961 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.399106 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.399296 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.399399 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.399608 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.399695 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.399917 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400012 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400227 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400315 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400533 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400628 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400840 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.400935 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.401145 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.401239 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.401953 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.402049 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.402285 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.402372 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.402600 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.402685 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.402911 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403051 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403232 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403322 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403546 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403852 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.403939 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.404159 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.404246 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.404465 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.404551 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.404767 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.404903 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405067 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405155 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405366 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405453 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405665 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405765 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.405964 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406050 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406262 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406347 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406579 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406675 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406882 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.406967 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.407235 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.407335 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.407537 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.407634 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.407846 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.407980 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.408154 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.408248 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.408459 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.408556 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.408761 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.408847 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409066 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409214 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409377 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409465 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409679 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409766 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.409980 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410066 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410293 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410380 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410595 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410682 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410895 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.410989 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.411203 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.411324 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.411527 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.411604 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.411996 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412143 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412245 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412328 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412434 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412522 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412738 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.412833 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413045 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413176 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413355 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413450 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413664 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413759 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.413971 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.414059 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.414278 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.414396 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.414608 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.414720 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.414908 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415011 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415236 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415344 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415555 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415657 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415869 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.415964 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.416172 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.416261 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.416469 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.416555 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.416768 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.416861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.417083 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.417168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.417943 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418043 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418232 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418327 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418617 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418828 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.418914 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.419127 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.419295 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.419451 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.419538 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.419750 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.419837 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420048 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420133 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420367 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420462 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420671 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420765 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.420968 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421053 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421265 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421364 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421559 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421893 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.421979 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.422199 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.422358 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.422534 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.422669 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.422851 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.422987 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.423165 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.423341 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.423497 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.423585 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.423804 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.423898 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.424110 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.424197 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.424414 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.424500 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.424720 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.424805 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425024 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425111 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425331 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425419 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425638 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425724 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.425940 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426027 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426248 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426334 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426553 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426638 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426862 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.426994 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.427165 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.427283 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.427490 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.427576 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.427803 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.427892 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.428137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.428237 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.428465 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.428562 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.428780 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.428875 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.429090 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.429175 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.429400 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.429499 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.429705 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.429792 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430009 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430095 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430316 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430417 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430620 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430705 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.430925 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431019 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431271 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431383 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431554 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431642 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431857 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.431943 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.432406 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.432553 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.432737 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.432824 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433052 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433138 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433357 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433452 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433656 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433742 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.433957 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434051 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434266 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434355 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434588 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434674 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434893 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.434986 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.435203 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.435312 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.435537 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.435632 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.435842 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.435929 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.436147 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.436234 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.436452 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.436537 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.436753 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.436849 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437052 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437138 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437354 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437441 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437659 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437758 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.437963 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438050 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438268 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438367 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438565 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438660 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438860 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.438946 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.439166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.439271 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.439505 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.439618 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.439802 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.439889 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.440105 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.440199 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.440414 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.440504 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.440716 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.440802 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441020 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441106 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441335 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441423 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441637 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441724 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.441937 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442024 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442236 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442323 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442545 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442637 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442845 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.442932 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.443143 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.443264 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.443469 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.443557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.443770 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.443866 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.444106 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.444203 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.444409 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.444506 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.444710 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.444805 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445023 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445116 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445327 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445412 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445632 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445729 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.445937 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446024 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446241 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446327 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446546 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446643 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446855 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.446942 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.447171 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.447291 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.447491 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.447579 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.447797 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.447883 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.448103 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.448188 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.448434 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.448535 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.448736 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.448831 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449045 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449138 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449349 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449435 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449653 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449738 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.449953 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.450040 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.450257 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.450344 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.450562 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.450649 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.450877 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.451127 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.451461 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.451551 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.451787 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.451873 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.452097 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.452196 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.452415 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.452502 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.452742 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.452843 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453059 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453155 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453382 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453468 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453694 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453785 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.453995 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454127 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454295 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454390 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454597 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454685 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454897 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.454985 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.455198 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.455327 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.455528 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.455616 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.455830 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.455917 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.456130 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.456224 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.456428 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.456514 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.456728 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.456813 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457026 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457120 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457323 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457408 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457654 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457766 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.457924 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458013 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458234 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458320 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458534 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458641 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458838 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.458926 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.459136 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.459243 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.459479 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.459585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.459780 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.459868 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.460082 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.460168 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.460381 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.460467 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.460680 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.460769 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461009 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461096 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461310 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461407 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461643 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461731 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.461970 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462057 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462270 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462368 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462571 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462665 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462886 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.462971 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.463186 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.463351 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.463508 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.463596 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.463806 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.463895 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.464620 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.464800 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.464923 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465010 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465223 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465310 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465530 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465655 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465837 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.465972 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.466145 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.466279 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.466450 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.466586 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.466745 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.466893 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467050 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467190 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467372 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467517 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467684 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467820 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.467989 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.468131 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.468289 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.468437 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.468591 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.468744 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.468895 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469043 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469198 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469349 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469495 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469656 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.469956 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.470103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.470262 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.470414 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.470564 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.470714 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.470876 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471013 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471175 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471333 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471499 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471638 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471800 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.471943 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.472105 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.472242 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.472411 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.472623 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.472711 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.472934 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473081 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473223 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473366 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473574 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473713 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473879 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.473977 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.474178 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.474264 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.474475 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.474628 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.474775 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475021 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475122 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475223 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475418 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475510 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475723 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.475817 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476019 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476116 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476317 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476403 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476615 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476709 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.476912 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477008 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477209 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477295 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477504 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477801 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.477896 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478095 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478190 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478390 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478476 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478690 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478809 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.478987 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.479083 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.479321 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.479417 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.480152 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.480306 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.480456 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.480604 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.480740 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.480882 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.481052 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.481196 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.481363 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.481500 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.481676 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.481812 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482003 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482140 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482314 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482452 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482620 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482756 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.482925 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483015 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483246 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483382 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483558 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483705 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483851 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.483986 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.484157 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.484295 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.484462 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.484616 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.484766 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.484851 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485059 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485154 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485355 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485451 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485650 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485736 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.485962 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486049 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486266 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486362 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486572 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486660 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486886 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.486973 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.487204 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.487321 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.487525 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.487612 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.487832 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.487918 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.488138 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.488234 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.488444 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.488538 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.488745 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.488887 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489048 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489136 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489351 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489444 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489659 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489746 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.489964 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490058 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490268 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490354 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490573 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490659 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490874 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.490963 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.491172 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.491292 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.491498 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.491598 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.491800 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.491896 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.492120 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.492208 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.492427 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.492525 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.492728 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.492816 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493032 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493120 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493333 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493507 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493632 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493719 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.493930 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.494069 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.494229 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.494352 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.494648 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.494736 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.494956 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.495045 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.495298 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.495393 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.495607 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.495704 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.495914 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496009 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496221 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496313 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496527 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496615 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496829 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.496916 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.497127 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.497242 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.497541 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.497628 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.497843 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.497929 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.498147 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.498235 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.498446 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.498532 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.498745 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.498839 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499046 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499143 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499374 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499463 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499681 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499779 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.499982 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500071 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500283 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500370 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500587 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500688 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500885 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.500971 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.501190 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.501277 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.501504 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.501601 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.501891 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.501980 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.502193 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.502280 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.502495 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.502604 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.502906 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.502993 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.503253 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.503360 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.503543 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.503643 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.503861 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.503950 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.504178 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.504264 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.504478 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.504564 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.504789 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.504885 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.505096 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.505193 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.505412 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.505501 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.505728 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.505816 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506033 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506120 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506343 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506431 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506643 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506739 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.506941 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507028 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507283 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507385 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507593 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507683 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507901 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.507988 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.508220 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.508321 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.508611 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.508699 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.508918 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509007 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509234 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509332 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509550 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509640 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509848 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.509980 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.510149 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.510247 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.510447 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.510543 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.510744 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.510860 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.511069 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.511159 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.511408 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.511498 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.511709 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.511810 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512016 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512109 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512319 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512406 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512622 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512710 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.512919 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513016 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513217 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513304 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513518 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513609 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513817 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.513905 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.514120 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.514243 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.514445 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.514576 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.514740 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.514836 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.515057 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.515157 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.515381 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.515484 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.515699 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.515789 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516004 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516092 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516303 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516401 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516602 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516696 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516900 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.516987 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.517197 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.517292 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.517528 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.517616 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.517843 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.517930 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.518167 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.518255 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.518491 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.518579 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.518797 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.518884 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.519108 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.519270 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.519457 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.519545 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.519775 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.519862 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.520083 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.520173 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.520389 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.520476 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.520709 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.520806 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521009 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521097 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521308 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521395 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521608 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521709 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521910 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.521996 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.522208 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.522294 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.522508 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.522604 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.522805 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.522892 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.523103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.523189 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.523437 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.523579 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.523737 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.523827 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524058 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524145 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524358 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524447 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524660 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524748 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.524967 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525053 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525269 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525367 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525565 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525651 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525862 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.525948 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.526159 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.526247 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527004 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527098 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527330 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527422 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527649 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527738 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.527952 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528039 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528267 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528363 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528578 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528665 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528887 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.528980 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.529195 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.529286 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.529504 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.529597 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.529811 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.529897 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.530118 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.530213 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.530422 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.530511 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.530728 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.530814 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.531040 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.531135 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.531376 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.531475 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.531693 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.531899 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.532209 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.532306 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.532523 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.532610 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.532831 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.532918 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.533140 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.533229 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.533445 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.533533 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.533755 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.533850 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534061 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534149 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534367 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534506 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534673 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534761 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.534979 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.535074 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.535307 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.535410 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.535632 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.535731 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.535949 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536037 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536269 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536357 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536582 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536677 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536894 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.536982 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.537205 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.537291 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.537516 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.537611 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.537826 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.537922 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.538166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.538253 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.538470 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.538566 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.538771 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.538865 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.539079 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.539169 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.539413 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.539501 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.539723 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.539813 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540031 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540127 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540336 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540422 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540739 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.540955 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541053 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541262 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541350 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541564 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541650 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541873 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.541968 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.542229 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.542315 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.542550 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.542639 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.542866 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.542954 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.543180 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.543300 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.543515 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.543602 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.543824 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.543920 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.544135 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.544334 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.544647 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.544748 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.544955 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.545043 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.545282 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.545372 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.545601 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.545705 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.545914 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546009 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546221 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546315 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546534 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546631 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546835 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.546923 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.547135 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.547258 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.547460 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.547557 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.547764 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.547852 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548065 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548363 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548452 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548678 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548773 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.548978 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.549065 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.549277 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.549374 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.549585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.549672 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.549885 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.550115 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.550410 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.550500 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.550751 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.550838 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.551069 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.551158 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.551415 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.551506 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.551732 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.551821 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552038 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552135 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552339 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552426 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552658 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552745 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.552958 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553061 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553260 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553348 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553567 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553662 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553869 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.553966 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.554170 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.554256 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.554468 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.554548 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.554773 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.554874 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555074 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555162 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555399 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555488 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555702 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555791 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.555999 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.556085 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.556315 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.556402 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.556617 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.556705 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.556918 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.557004 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.557467 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.557569 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.558278 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.558378 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.558580 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.558669 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.558881 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.558968 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.559183 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.559332 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.559508 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.559597 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.559810 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.559915 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.560108 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.560196 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.560411 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.560507 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.560707 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.560814 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561017 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561113 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561358 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561446 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561662 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561759 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.561962 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562049 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562274 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562362 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562573 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562740 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562873 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.562968 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.563185 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.563324 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.563515 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.563612 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.563826 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.563912 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.564134 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.564229 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.564440 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.564529 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.564776 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.564864 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.565089 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.565306 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.565618 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.565707 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.565947 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.566034 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.566266 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.566353 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.566594 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.566682 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.566918 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567020 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567227 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567332 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567541 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567629 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567849 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.567938 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.568160 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.568255 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.568473 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.568559 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.568782 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.568868 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.569088 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.569184 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.569395 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.569484 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.569701 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.569835 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570007 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570104 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570314 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570395 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570618 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570704 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.570928 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571016 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571254 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571355 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571563 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571653 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571868 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.571965 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.572173 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.572261 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.572478 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.572567 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.572787 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.572877 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.573118 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.573204 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.573971 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.574124 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.574286 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.574376 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.574608 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.574740 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.574917 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575026 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575239 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575330 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575553 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575656 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575862 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.575976 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.576164 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.576250 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.576476 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.576563 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.576785 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.576873 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.577089 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.577176 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.577390 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.577738 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578039 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578351 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578439 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578669 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578756 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.578981 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.579069 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.579308 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.579399 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.579635 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.579751 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.579947 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580045 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580251 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580338 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580559 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580662 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580866 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.580954 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.581198 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.581286 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.581527 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.581624 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.581848 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.581936 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.582153 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.582240 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.582453 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.582540 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.582754 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.582840 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583053 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583146 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583384 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583476 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583689 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583783 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.583992 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584293 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584432 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584680 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584888 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.584976 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.585188 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.585275 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.585487 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.585573 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.585785 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.585895 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586089 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586195 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586382 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586470 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586678 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586773 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.586977 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.587063 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.587314 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.587405 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.587620 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.587722 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.587919 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588007 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588218 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588306 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588523 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588619 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588818 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.588905 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.589141 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.589227 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.589442 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.589530 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.589741 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.589838 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590043 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590161 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590370 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590480 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590681 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590827 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.590997 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.591135 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.591329 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.591475 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.591645 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.591788 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.591934 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.592145 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.592283 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.592419 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.592554 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.592689 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.592864 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593010 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593171 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593309 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593459 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593594 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593788 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.593941 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594085 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594228 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594374 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594517 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594686 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594834 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.594992 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.595137 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.595316 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.595404 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.595612 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.595703 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.595939 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596027 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596242 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596329 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596552 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596641 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596865 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.596953 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.597177 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.597264 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.597488 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.597576 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.597795 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.597884 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.598101 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.598196 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.598414 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.598502 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.598719 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.598807 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599024 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599122 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599351 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599442 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599659 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599746 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.599964 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600072 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600270 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600368 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600573 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600661 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600881 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.600979 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.601192 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.601279 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.601504 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.601591 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.601826 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.601915 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.602132 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.602220 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.602440 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.602527 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.602762 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.602852 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.603085 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.603174 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.603422 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.603511 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.603747 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.603836 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.604074 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.604161 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.604385 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.604519 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.604717 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.604804 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.605020 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.605107 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.605263 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 06:54:28.605362 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 06:54:28.605546 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 06:54:28.757689 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO dbcounter [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Registered counter for database nova_api Oct 17 06:54:28.757868 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO dbcounter [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Registered counter for database nova_api Oct 17 06:54:28.778472 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_db.sqlalchemy.engines [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:28.781353 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_db.sqlalchemy.engines [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:28.785332 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writer thread running {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:28.787932 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writer thread running {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:28.841787 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.context [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48e99de6-00ec-4832-bccb-b295fdd3a218(cell1) {{(pid=103767) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 06:54:28.844013 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.context [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48e99de6-00ec-4832-bccb-b295fdd3a218(cell1) {{(pid=103768) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 06:54:28.845635 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 06:54:28.846103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 06:54:28.847676 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 06:54:28.847899 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_concurrency.lockutils [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 06:54:28.848368 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_concurrency.lockutils [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 06:54:28.848461 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 06:54:28.848820 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 06:54:28.849928 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_concurrency.lockutils [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 06:54:28.850645 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_concurrency.lockutils [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 06:54:28.850787 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 06:54:28.851085 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_concurrency.lockutils [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 06:54:28.852772 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO dbcounter [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Registered counter for database nova_cell0 Oct 17 06:54:28.853077 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_concurrency.lockutils [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 06:54:28.855599 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO dbcounter [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Registered counter for database nova_cell0 Oct 17 06:54:28.857327 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO dbcounter [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Registered counter for database nova_cell1 Oct 17 06:54:28.859591 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO dbcounter [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Registered counter for database nova_cell1 Oct 17 06:54:28.864568 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_db.sqlalchemy.engines [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:28.867076 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_db.sqlalchemy.engines [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:28.868391 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_db.sqlalchemy.engines [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:28.869998 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writer thread running {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:28.871448 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_db.sqlalchemy.engines [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:28.876172 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writer thread running {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:28.878829 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writer thread running {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:29.007224 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writer thread running {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:29.016299 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO dbcounter [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Registered counter for database nova_cell0 Oct 17 06:54:29.021731 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO dbcounter [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Registered counter for database nova_cell0 Oct 17 06:54:29.025057 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_db.sqlalchemy.engines [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:29.029192 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG oslo_db.sqlalchemy.engines [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 06:54:29.030448 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writer thread running {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:29.033919 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writer thread running {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 06:54:29.369339 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: WARNING keystonemiddleware.auth_token [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 06:54:29.371101 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: WARNING keystonemiddleware.auth_token [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 06:54:29.376609 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: WARNING keystonemiddleware.auth_token [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 06:54:29.378322 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: WARNING keystonemiddleware.auth_token [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 06:54:29.718057 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: WARNING keystonemiddleware.auth_token [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 06:54:29.721022 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: WARNING keystonemiddleware.auth_token [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 06:54:29.724046 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: WARNING keystonemiddleware.auth_token [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 06:54:29.726962 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: WARNING keystonemiddleware.auth_token [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 06:54:29.729236 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613468e09c0 pid: 103768 (default app) Oct 17 06:54:29.731875 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:54:29.733053 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-9f485652-3753-4c39-82b4-13ed5baf020a None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Oct 17 06:54:29.733349 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613468e09c0 pid: 103767 (default app) Oct 17 06:54:29.733443 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Mon Oct 17 06:54:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:55:50.204843 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:55:50.206053 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Oct 17 06:55:50.206923 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:55:50.218490 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_api:SELECT=3 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:50.219632 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_cell0:SELECT=3 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:50.221689 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_cell1:SELECT=3 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:50.222519 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:51.081510 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-9b60375c-ed72-4fa1-8387-06f71c24f181 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:55:51.114478 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-9b60375c-ed72-4fa1-8387-06f71c24f181 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901425 Oct 17 06:55:51.115284 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 17 06:55:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:55:53.727353 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:55:53.728380 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-e1cb2e9e-baaa-41f8-a0ce-d265d5f672f4 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 17 06:55:53.728783 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:55:54.173295 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a6b834ae-4d34-4c44-b8d0-68724172fdbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:55:54.222060 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a6b834ae-4d34-4c44-b8d0-68724172fdbb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486890 Oct 17 06:55:54.222619 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:55:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:55:54.236826 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_api:SELECT=3 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:54.237683 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_cell1:SELECT=3 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:54.239640 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_cell0:SELECT=3 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:54.240994 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:55:54.448463 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-bd5772e7-42b9-4640-939f-21231348a5b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:55:54.514573 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-bd5772e7-42b9-4640-939f-21231348a5b2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282902 Oct 17 06:55:54.515162 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 17 06:55:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:55:57.112536 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a6b834ae-4d34-4c44-b8d0-68724172fdbb admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:55:57.114280 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a6b834ae-4d34-4c44-b8d0-68724172fdbb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Oct 17 06:55:57.115387 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:55:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:55:57.770522 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a4206f3e-0eb1-40f6-bdb5-07ecdce8f0b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "ram": 512}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:55:57.810679 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-a4206f3e-0eb1-40f6-bdb5-07ecdce8f0b7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689080 Oct 17 06:55:57.811261 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:55:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:55:57.825885 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-6276edb7-6908-4eda-a409-ae06bc90eeb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:55:57.872730 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-6276edb7-6908-4eda-a409-ae06bc90eeb9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051341 Oct 17 06:55:57.873499 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 17 06:55:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:00.458711 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a4206f3e-0eb1-40f6-bdb5-07ecdce8f0b7 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:00.459762 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-a4206f3e-0eb1-40f6-bdb5-07ecdce8f0b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 17 06:56:00.460166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:00.869563 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-dc716f70-333c-4eb4-84c5-d2e03e4d44b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:00.890977 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-dc716f70-333c-4eb4-84c5-d2e03e4d44b1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424147 Oct 17 06:56:00.891727 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:00.904120 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-48aed7f0-5785-4861-9df8-35ce668d81f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:00.932830 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-48aed7f0-5785-4861-9df8-35ce668d81f4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032434 Oct 17 06:56:00.933586 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 17 06:56:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:03.560322 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-dc716f70-333c-4eb4-84c5-d2e03e4d44b1 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:03.561334 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-dc716f70-333c-4eb4-84c5-d2e03e4d44b1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 17 06:56:03.561735 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:03.978486 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-2f04f03b-53fc-4a9a-adff-2ea6f4f070e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d3", "ram": 2048, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:03.997669 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-2f04f03b-53fc-4a9a-adff-2ea6f4f070e1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429358 Oct 17 06:56:03.998532 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:04.010904 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-763422cd-05b4-4357-9746-c0d4aec8ea7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:04.038606 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-763422cd-05b4-4357-9746-c0d4aec8ea7e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031338 Oct 17 06:56:04.043329 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 17 06:56:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:06.675911 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-2f04f03b-53fc-4a9a-adff-2ea6f4f070e1 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:06.677443 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-2f04f03b-53fc-4a9a-adff-2ea6f4f070e1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002507 Oct 17 06:56:06.678080 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:07.111979 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-26f609c1-d84b-4d26-973e-fae2f22ca079 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:07.133958 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-26f609c1-d84b-4d26-973e-fae2f22ca079 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447880 Oct 17 06:56:07.134535 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:07.149455 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-7c89e2a4-a02c-49e9-882f-7c95488e8e8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:07.190950 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-7c89e2a4-a02c-49e9-882f-7c95488e8e8d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047549 Oct 17 06:56:07.191760 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Mon Oct 17 06:56:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:10.591018 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-26f609c1-d84b-4d26-973e-fae2f22ca079 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:10.592114 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-26f609c1-d84b-4d26-973e-fae2f22ca079 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 17 06:56:10.592476 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 06:56:11.002827 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-16db9060-082c-4458-9935-cc2e3692ede6 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:11.027065 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-16db9060-082c-4458-9935-cc2e3692ede6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.428218 Oct 17 06:56:11.027644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 17 06:56:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:56:13.700493 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-26f609c1-d84b-4d26-973e-fae2f22ca079 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:13.701515 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-26f609c1-d84b-4d26-973e-fae2f22ca079 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 17 06:56:13.701918 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:14.133613 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-952ced01-5559-4d7e-85f4-1d322feeaa66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:14.156109 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-952ced01-5559-4d7e-85f4-1d322feeaa66 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.447835 Oct 17 06:56:14.156701 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:14.169572 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-cbf1be56-2648-4276-952f-57a82517342e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:14.199570 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-cbf1be56-2648-4276-952f-57a82517342e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033678 Oct 17 06:56:14.200201 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 17 06:56:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:16.854497 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-952ced01-5559-4d7e-85f4-1d322feeaa66 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:16.855575 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-952ced01-5559-4d7e-85f4-1d322feeaa66 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 17 06:56:16.856011 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:17.252519 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-0c254f7d-4235-47f5-810d-b4e8dd81c2fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "id": "2"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:17.272027 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-0c254f7d-4235-47f5-810d-b4e8dd81c2fe admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409701 Oct 17 06:56:17.272514 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:17.284449 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-0d4c3e9f-984b-4c94-9325-3676e416993a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:17.308462 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-0d4c3e9f-984b-4c94-9325-3676e416993a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027740 Oct 17 06:56:17.309036 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 17 06:56:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 06:56:19.927818 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-0c254f7d-4235-47f5-810d-b4e8dd81c2fe admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:19.928824 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-0c254f7d-4235-47f5-810d-b4e8dd81c2fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 17 06:56:19.929233 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:20.325639 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-5784deb7-4fa6-4ad1-8f54-e5c0e31b4bef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "disk": 40, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:20.346741 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-5784deb7-4fa6-4ad1-8f54-e5c0e31b4bef admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.411021 Oct 17 06:56:20.347624 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:20.359763 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-69e22368-7172-4498-8fec-3fe0fd2d898a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:20.365328 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:56:20.391392 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-69e22368-7172-4498-8fec-3fe0fd2d898a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035212 Oct 17 06:56:20.407237 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 17 06:56:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 06:56:22.986942 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-5784deb7-4fa6-4ad1-8f54-e5c0e31b4bef admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:22.988104 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-5784deb7-4fa6-4ad1-8f54-e5c0e31b4bef admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Oct 17 06:56:22.988510 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:23.443793 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-492800c0-adcd-4ef7-ab69-443c78f98322 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "vcpus": 4, "disk": 80, "swap": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:23.466514 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-492800c0-adcd-4ef7-ab69-443c78f98322 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471824 Oct 17 06:56:23.467051 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:23.479485 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-e49ec15a-5918-46fc-b2fe-486fd67d4e6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:23.506443 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-e49ec15a-5918-46fc-b2fe-486fd67d4e6e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030504 Oct 17 06:56:23.507029 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 17 06:56:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:26.155851 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-492800c0-adcd-4ef7-ab69-443c78f98322 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:26.157631 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-492800c0-adcd-4ef7-ab69-443c78f98322 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Oct 17 06:56:26.158643 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:26.591113 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-d70502e4-69b2-4f96-b5dd-d8c0e854db75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:26.601450 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:56:26.616311 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-d70502e4-69b2-4f96-b5dd-d8c0e854db75 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.451504 Oct 17 06:56:26.616864 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Mon Oct 17 06:56:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:26.628959 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-926b3fef-679e-496c-a2f5-0af1f19da324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:26.655538 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-926b3fef-679e-496c-a2f5-0af1f19da324 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030195 Oct 17 06:56:26.656303 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Mon Oct 17 06:56:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:56:45.795255 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-d70502e4-69b2-4f96-b5dd-d8c0e854db75 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:45.796189 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-d70502e4-69b2-4f96-b5dd-d8c0e854db75 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 17 06:56:45.796591 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:56:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:45.807744 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:56:46.202758 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-df55830e-0d47-463a-a2f6-0fb4ca32d490 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:46.220731 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-df55830e-0d47-463a-a2f6-0fb4ca32d490 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.417726 Oct 17 06:56:46.221269 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 17 06:56:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:56:47.517343 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-d70502e4-69b2-4f96-b5dd-d8c0e854db75 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:47.518336 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-d70502e4-69b2-4f96-b5dd-d8c0e854db75 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 17 06:56:47.518729 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:48.040808 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-d6aa8fcb-8555-4747-a998-621439e7e976 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:48.046328 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.wsgi [None req-d6aa8fcb-8555-4747-a998-621439e7e976 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-d6aa8fcb-8555-4747-a998-621439e7e976 admin admin] Request method failure captured: Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Accept: application/json Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Accept-Encoding: gzip, deflate Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Connection: keep-alive Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Content-Length: 0 Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Host: 10.222.0.36 Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Openstack-Api-Version: compute 2.92 Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Openstack-System-Scope: None Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: User-Agent: python-novaclient Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Auth-Token: gAAAAABjTPyvN3KEctyBFkHzWnJjACFGXuqyptejwYXXeHVUPcR0SxxpS9_3V6tLyO1kTmY8zHVAemDuw8Lc6U8VKeY5YF8tpQo7PK2sF968x3WvdMBR1nNIKBpmF3lctO7t1lTHWuEDA-q-y5Z-wcXiRdNNJZOLH5-TcuPNq9RtgtFQhcbJ2pE Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Domain-Id: None Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Domain-Name: None Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Identity-Status: Confirmed Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Is-Admin-Project: True Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Domain-Id: default Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Domain-Name: Default Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Name: admin Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Role: member,admin,reader Oct 17 06:56:48.049557 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Roles: member,admin,reader Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86c1b532428347929d42c84633169ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86c1b532428347929d42c84633169ba2"}]}] Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant: admin Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant-Name: admin Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User: admin Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Domain-Id: default Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Domain-Name: Default Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Id: be01c4fc32bc463e9e081f13d9758f92 Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Name: admin Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: method: > Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: exception: Flavor 42 could not be found. Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: action_args: {'id': '42'} Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 06:56:48.051153 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:48.052100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.053590 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-d6aa8fcb-8555-4747-a998-621439e7e976 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 06:56:48.055512 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-d6aa8fcb-8555-4747-a998-621439e7e976 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.385722 Oct 17 06:56:48.055512 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 17 06:56:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 06:56:48.061169 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a02e29e0-4680-4024-941c-dffe06045e49 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:48.083715 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-a02e29e0-4680-4024-941c-dffe06045e49 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026120 Oct 17 06:56:48.084274 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 17 06:56:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 06:56:48.094852 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-64465284-fbaa-4def-a916-1a32084ba0d3 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:48.116762 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-64465284-fbaa-4def-a916-1a32084ba0d3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026409 Oct 17 06:56:48.117281 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 17 06:56:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:56:48.126670 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-cbd22405-dd8d-4cf4-8fdc-23a229a6f534 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:48.131943 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.wsgi [None req-cbd22405-dd8d-4cf4-8fdc-23a229a6f534 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-cbd22405-dd8d-4cf4-8fdc-23a229a6f534 admin admin] Request method failure captured: Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Accept: application/json Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Accept-Encoding: gzip, deflate Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Connection: keep-alive Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Content-Length: 0 Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Host: 10.222.0.36 Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Openstack-Api-Version: compute 2.92 Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Openstack-System-Scope: None Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: User-Agent: python-novaclient Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Auth-Token: gAAAAABjTPyvN3KEctyBFkHzWnJjACFGXuqyptejwYXXeHVUPcR0SxxpS9_3V6tLyO1kTmY8zHVAemDuw8Lc6U8VKeY5YF8tpQo7PK2sF968x3WvdMBR1nNIKBpmF3lctO7t1lTHWuEDA-q-y5Z-wcXiRdNNJZOLH5-TcuPNq9RtgtFQhcbJ2pE Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Domain-Id: None Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Domain-Name: None Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Identity-Status: Confirmed Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Is-Admin-Project: True Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Domain-Id: default Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Domain-Name: Default Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Name: admin Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Role: member,admin,reader Oct 17 06:56:48.135166 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Roles: member,admin,reader Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86c1b532428347929d42c84633169ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86c1b532428347929d42c84633169ba2"}]}] Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant: admin Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant-Name: admin Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User: admin Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Domain-Id: default Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Domain-Name: Default Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Id: be01c4fc32bc463e9e081f13d9758f92 Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Name: admin Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: method: > Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: exception: Flavor 42 could not be found. Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: action_args: {'id': '42'} Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 06:56:48.136806 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:48.137791 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:48.139103 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-cbd22405-dd8d-4cf4-8fdc-23a229a6f534 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 06:56:48.140341 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-cbd22405-dd8d-4cf4-8fdc-23a229a6f534 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013644 Oct 17 06:56:48.140341 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 17 06:56:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 06:56:49.335562 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-64465284-fbaa-4def-a916-1a32084ba0d3 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:49.336579 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-64465284-fbaa-4def-a916-1a32084ba0d3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 17 06:56:49.336981 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:49.851572 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a04c05af-cbc0-4066-ac35-6d7b38d902e4 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:49.856598 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.wsgi [None req-a04c05af-cbc0-4066-ac35-6d7b38d902e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a04c05af-cbc0-4066-ac35-6d7b38d902e4 admin admin] Request method failure captured: Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Accept: application/json Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Accept-Encoding: gzip, deflate Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Connection: keep-alive Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Content-Length: 0 Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Host: 10.222.0.36 Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Openstack-Api-Version: compute 2.92 Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Openstack-System-Scope: None Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: User-Agent: python-novaclient Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Auth-Token: gAAAAABjTPyxo_EGkBkxIP3e13cKeunU4wR1Oiu4rN5bSEdsF2ko7DjkfmEXcOqvTBIJ3GgajxG2woulIGAo9DGpcWDkpKNwo_iX_HPAvnHkj7iOAMbgCPeomT55Ug4Dcles9XBtD8J-rPRq2b4PYo1Deg88YLhYRlC_JJtwfn7rucapHyDfqlY Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Domain-Id: None Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Domain-Name: None Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Identity-Status: Confirmed Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Is-Admin-Project: True Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Domain-Id: default Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Domain-Name: Default Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Name: admin Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Role: member,admin,reader Oct 17 06:56:49.858091 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Roles: member,admin,reader Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86c1b532428347929d42c84633169ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86c1b532428347929d42c84633169ba2"}]}] Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant: admin Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant-Name: admin Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User: admin Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Domain-Id: default Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Domain-Name: Default Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Id: be01c4fc32bc463e9e081f13d9758f92 Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Name: admin Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: method: > Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: exception: Flavor 84 could not be found. Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: action_args: {'id': '84'} Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 06:56:49.859585 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:49.860531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.861644 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a04c05af-cbc0-4066-ac35-6d7b38d902e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 06:56:49.863459 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-a04c05af-cbc0-4066-ac35-6d7b38d902e4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387014 Oct 17 06:56:49.863459 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 17 06:56:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 06:56:49.869919 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-6f26f179-3c38-4a48-aa08-12461a0bc669 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:49.884768 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-6f26f179-3c38-4a48-aa08-12461a0bc669 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018494 Oct 17 06:56:49.885278 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 17 06:56:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 06:56:49.894345 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a1bb304e-5a3b-4285-a555-325a2c3f96cb admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:49.910261 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-a1bb304e-5a3b-4285-a555-325a2c3f96cb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018856 Oct 17 06:56:49.910786 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 17 06:56:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:56:49.920016 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-304f2b27-783a-461d-91a7-28e6a5dd9540 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:49.924918 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.wsgi [None req-304f2b27-783a-461d-91a7-28e6a5dd9540 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-304f2b27-783a-461d-91a7-28e6a5dd9540 admin admin] Request method failure captured: Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Accept: application/json Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Accept-Encoding: gzip, deflate Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Connection: keep-alive Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Content-Length: 0 Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Host: 10.222.0.36 Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Openstack-Api-Version: compute 2.92 Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Openstack-System-Scope: None Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: User-Agent: python-novaclient Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Auth-Token: gAAAAABjTPyxo_EGkBkxIP3e13cKeunU4wR1Oiu4rN5bSEdsF2ko7DjkfmEXcOqvTBIJ3GgajxG2woulIGAo9DGpcWDkpKNwo_iX_HPAvnHkj7iOAMbgCPeomT55Ug4Dcles9XBtD8J-rPRq2b4PYo1Deg88YLhYRlC_JJtwfn7rucapHyDfqlY Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Domain-Id: None Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Domain-Name: None Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Identity-Status: Confirmed Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Is-Admin-Project: True Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Domain-Id: default Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Domain-Name: Default Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Name: admin Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Role: member,admin,reader Oct 17 06:56:49.927102 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Roles: member,admin,reader Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86c1b532428347929d42c84633169ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86c1b532428347929d42c84633169ba2"}]}] Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant: admin Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant-Name: admin Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User: admin Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Domain-Id: default Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Domain-Name: Default Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Id: be01c4fc32bc463e9e081f13d9758f92 Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Name: admin Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: method: > Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: exception: Flavor 84 could not be found. Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: action_args: {'id': '84'} Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 06:56:49.928667 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:49.929861 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:49.931179 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-304f2b27-783a-461d-91a7-28e6a5dd9540 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 06:56:49.932470 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-304f2b27-783a-461d-91a7-28e6a5dd9540 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012035 Oct 17 06:56:49.932470 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Mon Oct 17 06:56:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 06:56:51.137026 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-a1bb304e-5a3b-4285-a555-325a2c3f96cb admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:51.138021 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-a1bb304e-5a3b-4285-a555-325a2c3f96cb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 17 06:56:51.138408 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:51.650919 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-db95e205-ed2d-4930-abbb-6264f1fddf15 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:51.656798 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.wsgi [None req-db95e205-ed2d-4930-abbb-6264f1fddf15 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-db95e205-ed2d-4930-abbb-6264f1fddf15 admin admin] Request method failure captured: Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Accept: application/json Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Accept-Encoding: gzip, deflate Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Connection: keep-alive Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Content-Length: 0 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Host: 10.222.0.36 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Openstack-Api-Version: compute 2.92 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Openstack-System-Scope: None Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: User-Agent: python-novaclient Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Auth-Token: gAAAAABjTPyzvL3u5xlc9y_AdOtLGTj1ZeJkUuC3MwhzL8-BFxrPCLD0QrTLF7238aSbXk-ub7VqVAvAwSgXVt1Y7DLZV_eGKUUqMiOrw6PWGAiSkqDUfKpU18I2GxmBRNfIxjjlJMjdmQIlMvUaTtikgMXlvR40ziAupC29CMmDT528DdqE1G8 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Domain-Id: None Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Domain-Name: None Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Identity-Status: Confirmed Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Is-Admin-Project: True Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Domain-Id: default Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Domain-Name: Default Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Project-Name: admin Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Role: member,admin,reader Oct 17 06:56:51.658272 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Roles: member,admin,reader Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86c1b532428347929d42c84633169ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86c1b532428347929d42c84633169ba2"}]}] Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant: admin Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-Tenant-Name: admin Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User: admin Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Domain-Id: default Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Domain-Name: Default Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Id: be01c4fc32bc463e9e081f13d9758f92 Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: X-User-Name: admin Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: method: > Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: exception: Flavor 451 could not be found. Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: action_args: {'id': '451'} Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 06:56:51.659933 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:51.660872 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.662333 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-db95e205-ed2d-4930-abbb-6264f1fddf15 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 06:56:51.663619 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-db95e205-ed2d-4930-abbb-6264f1fddf15 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.383185 Oct 17 06:56:51.663619 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 17 06:56:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 06:56:51.669404 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-5ec262b6-0ac1-4a8a-9c1d-776e99217564 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:51.685403 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-5ec262b6-0ac1-4a8a-9c1d-776e99217564 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019382 Oct 17 06:56:51.685977 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 17 06:56:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:56:51.696629 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:51.712129 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019097 Oct 17 06:56:51.712711 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Mon Oct 17 06:56:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:56:51.722614 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-198b2592-07d0-4982-82d8-8ebe101fc8e4 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:51.727680 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.wsgi [None req-198b2592-07d0-4982-82d8-8ebe101fc8e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-198b2592-07d0-4982-82d8-8ebe101fc8e4 admin admin] Request method failure captured: Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Accept: application/json Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Accept-Encoding: gzip, deflate Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Connection: keep-alive Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Content-Length: 0 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Host: 10.222.0.36 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Openstack-Api-Version: compute 2.92 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Openstack-System-Scope: None Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: User-Agent: python-novaclient Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Auth-Token: gAAAAABjTPyzvL3u5xlc9y_AdOtLGTj1ZeJkUuC3MwhzL8-BFxrPCLD0QrTLF7238aSbXk-ub7VqVAvAwSgXVt1Y7DLZV_eGKUUqMiOrw6PWGAiSkqDUfKpU18I2GxmBRNfIxjjlJMjdmQIlMvUaTtikgMXlvR40ziAupC29CMmDT528DdqE1G8 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Domain-Id: None Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Domain-Name: None Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Identity-Status: Confirmed Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Is-Admin-Project: True Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Domain-Id: default Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Domain-Name: Default Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Project-Name: admin Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Role: member,admin,reader Oct 17 06:56:51.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Roles: member,admin,reader Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86c1b532428347929d42c84633169ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86c1b532428347929d42c84633169ba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86c1b532428347929d42c84633169ba2"}]}] Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant: admin Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant-Id: 86c1b532428347929d42c84633169ba2 Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-Tenant-Name: admin Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User: admin Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Domain-Id: default Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Domain-Name: Default Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Id: be01c4fc32bc463e9e081f13d9758f92 Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: X-User-Name: admin Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: method: > Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: exception: Flavor 451 could not be found. Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: action_args: {'id': '451'} Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 06:56:51.730747 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:51.731717 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: ERROR nova.api.openstack.wsgi Oct 17 06:56:51.733137 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-198b2592-07d0-4982-82d8-8ebe101fc8e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 06:56:51.734418 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-198b2592-07d0-4982-82d8-8ebe101fc8e4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011614 Oct 17 06:56:51.734418 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 17 06:56:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 06:56:52.937364 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:52.938381 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 17 06:56:52.938778 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:53.458211 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-7c69ac1a-81a7-4cbf-a8be-132b3fbbf14c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:53.477779 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-7c69ac1a-81a7-4cbf-a8be-132b3fbbf14c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397969 Oct 17 06:56:53.478330 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 17 06:56:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:54.672457 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:54.673452 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 17 06:56:54.673844 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:55.186363 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-68a35d7d-b212-4c9b-9be2-eb3bbc8ad23a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:55.205260 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-68a35d7d-b212-4c9b-9be2-eb3bbc8ad23a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395508 Oct 17 06:56:55.205813 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 17 06:56:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:56.430467 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:56.431491 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 17 06:56:56.431886 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:56.948536 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-50ed9b0d-5a97-4cf5-9dd2-b52afbe5be2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:56.966822 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-50ed9b0d-5a97-4cf5-9dd2-b52afbe5be2c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398501 Oct 17 06:56:56.967395 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 17 06:56:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:58.173249 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:58.174256 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 17 06:56:58.175280 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:56:58.688853 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-2e2e486f-ea5a-4f08-adbd-cf43572dc263 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 06:56:58.707232 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-2e2e486f-ea5a-4f08-adbd-cf43572dc263 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395656 Oct 17 06:56:58.707782 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Mon Oct 17 06:56:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 06:56:59.916709 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:56:59.917704 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 17 06:56:59.918100 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 06:56:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:57:00.436682 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-0c8850f2-3528-4f7b-b2ed-79d7700fffc1 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:00.456692 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-0c8850f2-3528-4f7b-b2ed-79d7700fffc1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399804 Oct 17 06:57:00.457221 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Mon Oct 17 06:57:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:57:56.360617 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:56.361591 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-561c3790-adc0-443f-ad3f-c6e402a72e9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 17 06:57:56.361981 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Mon Oct 17 06:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 06:57:56.372976 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:57:56.744096 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-9ed2fcb9-78b4-49c8-a9da-c4550a359657 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:56.764197 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-9ed2fcb9-78b4-49c8-a9da-c4550a359657 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395726 Oct 17 06:57:56.764729 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Mon Oct 17 06:57:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 06:57:56.785583 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_api:SELECT=14 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 06:57:56.789935 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-4f0eb13d-a1d6-4f4c-905a-0077a5c73cd4 admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:56.797544 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-4f0eb13d-a1d6-4f4c-905a-0077a5c73cd4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013371 Oct 17 06:57:56.798077 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Mon Oct 17 06:57:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:57:56.810554 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-48fcd161-d474-462e-b998-06c0fb9ab11d admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:56.817881 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-48fcd161-d474-462e-b998-06c0fb9ab11d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011144 Oct 17 06:57:56.818381 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Mon Oct 17 06:57:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 06:57:56.829242 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:56.836780 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010985 Oct 17 06:57:56.837286 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Mon Oct 17 06:57:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 06:57:56.848181 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-c24ad1be-9878-4ab0-af1d-9f3b4561bc23 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 06:57:56.856289 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-c24ad1be-9878-4ab0-af1d-9f3b4561bc23 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011403 Oct 17 06:57:56.856821 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Mon Oct 17 06:57:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:00:59.488128 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:00:59.489146 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 17 07:00:59.489548 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 07:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:00:59.628749 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_api:SELECT=6 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:00:59.783838 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:00:59.788602 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:00:59.789081 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:00:59.789510 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:00:59.790229 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:00:59.790682 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:00:59.791111 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:00:59.822857 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-b8028fb7-17de-47fa-b97e-c913ca8da53f admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195262 Oct 17 07:00:59.823431 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 17 07:00:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:01:00.906080 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:01:00.907077 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Oct 17 07:01:00.907583 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 07:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:01:01.098647 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:01:01.102009 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:01:01.102599 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:01:01.103031 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:01:01.103772 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:01:01.104216 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:01:01.104624 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:01:01.123781 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-f63ab141-4815-45f3-9d0a-050d8c98e50c admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075396 Oct 17 07:01:01.124261 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 17 07:01:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:01:12.597629 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:01:12.598661 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 17 07:01:12.599060 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 07:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:01:12.741986 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_cell0:SELECT=4 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:01:12.742690 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_cell1:SELECT=4 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:01:12.743379 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG dbcounter [-] [103767] Writing DB stats nova_api:SELECT=8 {{(pid=103767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:01:12.790590 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:01:12.793999 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:01:12.795125 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:01:12.795574 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:01:12.796279 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:01:12.796719 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:01:12.797131 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:01:12.821504 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-bc4ea7f0-4cff-4a22-949b-2ce3e5e10e3d admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083828 Oct 17 07:01:12.821979 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 17 07:01:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:01:13.893994 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG nova.api.openstack.wsgi [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] Calling method '>' {{(pid=103768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:01:13.894989 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: INFO nova.api.openstack.requestlog [None req-a83dc50b-4bd2-4018-a1f7-5fda237c2f6c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 17 07:01:13.895421 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: [pid: 103768|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Mon Oct 17 07:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:01:14.084206 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG nova.api.openstack.wsgi [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Calling method '>' {{(pid=103767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:01:14.087583 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:01:14.088071 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:01:14.088473 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:01:14.089173 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:01:14.089617 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:01:14.090024 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: DEBUG oslo_concurrency.lockutils [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:01:14.111027 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: INFO nova.api.openstack.requestlog [None req-f541b11c-e239-405c-8a74-ea9eb5fb83d8 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.076786 Oct 17 07:01:14.111531 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: [pid: 103767|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Oct 17 07:01:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:02:11.163997 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: Mon Oct 17 07:02:11 2022 - graceful shutdown triggered... Oct 17 07:02:11.164456 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: Gracefully killing worker 2 (pid: 103768)... Oct 17 07:02:11.164811 dv-cinder-845069-5-iscsi devstack@n-api.service[103767]: Gracefully killing worker 1 (pid: 103767)... Oct 17 07:02:11.170520 dv-cinder-845069-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 07:02:11.291049 dv-cinder-845069-5-iscsi devstack@n-api.service[103768]: DEBUG dbcounter [-] [103768] Writing DB stats nova_api:SELECT=4 {{(pid=103768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:12.165115 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: worker 1 buried after 1 seconds Oct 17 07:02:12.165553 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: worker 2 buried after 1 seconds Oct 17 07:02:12.165553 dv-cinder-845069-5-iscsi devstack@n-api.service[103766]: goodbye to uWSGI. Oct 17 07:02:12.166719 dv-cinder-845069-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 17 07:02:12.167309 dv-cinder-845069-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 07:02:12.169980 dv-cinder-845069-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 07:02:12.179179 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 07:02:12 2022] *** Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: nodename: dv-cinder-845069-5-iscsi Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: machine: x86_64 Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: clock source: unix Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: pcre jit disabled Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: detected number of CPU cores: 4 Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: current working directory: / Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: detected binary path: /usr/bin/uwsgi-core Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: your processes number limit is 47680 Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: your memory page size is 4096 bytes Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: detected max file descriptor number: 2048 Oct 17 07:02:12.181240 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: lock engine: pthread robust mutexes Oct 17 07:02:12.182099 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: thunder lock: enabled Oct 17 07:02:12.182099 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 07:02:12.182099 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 07:02:12.222088 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: Python main interpreter initialized at 0x55f0bdad89c0 Oct 17 07:02:12.222088 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: python threads support enabled Oct 17 07:02:12.222088 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: your server socket listen backlog is limited to 100 connections Oct 17 07:02:12.222088 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: your mercy for graceful operations on workers is 90 seconds Oct 17 07:02:12.222501 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 07:02:12.222501 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: *** Operational MODE: preforking *** Oct 17 07:02:12.222676 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: *** uWSGI is running in multiple interpreter mode *** Oct 17 07:02:12.222849 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: spawned uWSGI master process (pid: 118978) Oct 17 07:02:12.223201 dv-cinder-845069-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 07:02:12.224283 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: spawned uWSGI worker 1 (pid: 118995, cores: 1) Oct 17 07:02:12.224752 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: spawned uWSGI worker 2 (pid: 118996, cores: 1) Oct 17 07:02:12.225021 dv-cinder-845069-5-iscsi devstack@n-api.service[118978]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 07:02:12.885618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 07:02:12.887794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 07:02:14.055499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 07:02:14.055499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: from cryptography.utils import int_from_bytes Oct 17 07:02:14.056234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 07:02:14.056234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: from cryptography.utils import int_from_bytes Oct 17 07:02:14.065646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 07:02:14.065646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: from cryptography.utils import int_from_bytes Oct 17 07:02:14.066102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 07:02:14.066102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: from cryptography.utils import int_from_bytes Oct 17 07:02:16.490585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 07:02:16.491140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 07:02:16.491444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 07:02:16.491711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 07:02:16.491970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 07:02:16.492368 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.492704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.493034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.493378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.493727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.494049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.494380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.494706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.495268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.495542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.496035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.496724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-5-iscsi {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.497062 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.497419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.497746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.498080 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.498393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.498725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.499052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.499607 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.501001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.501001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.501001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.501439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.501665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.501978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.502308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.502627 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.502964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.503329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.503752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-5-iscsi {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.504084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.504403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.504708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.505140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.505460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.505771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.506097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.506426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.506734 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.507068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.507425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.507744 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.508071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.508379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.508690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.509007 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.509331 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.509638 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.509945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.510199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.510518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.510839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.511167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.511538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.511792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.512046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.512370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.512720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.513041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.513361 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.513664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.513978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.514291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.514602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.514912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.515300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.515578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.515906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.516229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.516542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.516867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.517277 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.517535 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.517849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.518197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.518521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.518834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.519158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.519524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.519839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.520151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.520473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.520799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.521142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.521454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.521723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.522017 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.522332 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.522659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.522973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.523310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.523628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.523934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.524250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.524565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.524763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 07:02:16.525288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.525497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 07:02:16.525657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.525657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.525976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 07:02:16.526150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.526308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 07:02:16.526453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.526603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 07:02:16.526764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.526920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.527071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.527283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.527455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.527629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.527788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.527940 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.528090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.528253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.528924 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.529131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.529327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.529479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.529638 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.529789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.529951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.530106 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.530255 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.530405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.530565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.530714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.530872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.531022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845069-5-iscsi {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.531173 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.531173 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.532493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.532654 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.532801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.532801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.533093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.533093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.533376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.533376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.533708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.533708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534348 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534498 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534649 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.534993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.535137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.535321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.535473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.535623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.535777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.535936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.536997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.537322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.537465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.537621 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.537771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.537922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845069-5-iscsi {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.538946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.539096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.539275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.539433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.539589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.539740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.539883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.540033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.540189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.540332 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.540491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.540641 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.540804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.540963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.541113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.541262 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.541405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.541548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.541710 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.541939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.542107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.542912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.543065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.543269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.543429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.543631 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.543781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.543931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.544110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.544785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.544937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.545093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.545273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.545419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.545419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.545706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.545859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.546012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.546164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.546314 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.546456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.546597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.546762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.546910 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.547053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.547197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.547922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.548086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.548238 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.548390 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.548543 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.548695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.548849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.548993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.549142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.549538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.549693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.549844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.550008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.550291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.550464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.550464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.550764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.550909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.551063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.551222 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.551373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.551532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.551676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.551819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.552083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.552234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.552906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.553172 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.553322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.553474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.553618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.553618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.553955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.553955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.554321 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.554471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.554621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.554783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.554942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.555087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.555296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.555296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.555573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.555715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.555875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.556036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.556188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.556188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.556467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.556609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.556771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.556921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.557065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.557208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.557356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.557510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.557777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.557941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.558097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.558249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.558403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.558562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.558706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.558859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.559009 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.559152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.559327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.559482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.559679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.559859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.560003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.560155 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.560298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.560452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.560604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.560754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.560908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.561274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.561435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.561591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.561735 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.561877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.562019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.562270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.563121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.563355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.563461 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.563548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.563641 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.563728 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.563873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.563975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.564078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.564170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.564261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.564353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.564444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.564542 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.564636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.564721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.564803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.564893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.564978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.565070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.565160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.565251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.565348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.565441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.565533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.565625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.565716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.565800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.565894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.565991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.566081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.566171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.566261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.566352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.566448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.566540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.566632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.566724 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.566808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.566890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.566986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.567078 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.567163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.567263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.567360 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.567455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.567540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.567630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.567714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.567796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.567879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.567970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.568054 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.568143 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.568234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.568325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.568417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.568514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.568606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.568700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.568794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.568879 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.568968 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.569077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.569162 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.569253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.569337 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.569428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.569525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.569618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.569712 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.569797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.569885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.569969 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.570064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570155 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.570247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570331 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 07:02:16.570421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570689 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570874 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.570996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.571186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.571325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.571566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.571676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.572142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.572248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.572492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.572616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.572835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.572937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.573157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.573252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.573486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.573599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.573798 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.573897 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.574115 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.574207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.574430 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.574534 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.574752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.574852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.575074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.575166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.575945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.576054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.576263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.576354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.576582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.576681 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.576907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577879 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.577979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.578209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.578306 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.578522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.578614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.578844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.578936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.579188 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.579300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.579535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.579626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.579861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.579953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.580190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.580281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.580506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.580610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.580822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.580913 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.581135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.581226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.581460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.581561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.581777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.581870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.582095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.582202 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.582414 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.582567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.582728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.582858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.583053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.583184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.583392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.583555 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.583758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.583888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584147 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.584947 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.585077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.585274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.585412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.585575 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.585700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.585889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586214 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586536 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.586977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.587166 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.587339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.587525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.587655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.587838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.587964 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.588150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.588269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.588466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.588592 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.588778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.588908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.589089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.589207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.589403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.589527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.589856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.590182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.590499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.590812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.591066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.591237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.591446 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.591584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.592927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.593004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.593075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.593162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.593767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.593890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.593984 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.594863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.595094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.595203 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.595439 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.595531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.595776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.595882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.596092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.596198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.596409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.596508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.596734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.596825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597143 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597367 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597680 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.597997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.598089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.598316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.598405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.598631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.598736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.598949 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.599047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.599302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.599410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.599607 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.599699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.599929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600255 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600668 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.600980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.601196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.601295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.601509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.601614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.601824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.601922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.602136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.602226 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.602447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.602720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.602812 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.603060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.603150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.603399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.603505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.603714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.603979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.604946 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.605047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.605260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.605351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.605572 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.605663 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.605883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.606033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.606220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.606318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.607052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.607161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.607397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.607500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.607711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.607811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608426 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.608959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609680 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.609997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.610214 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.610319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.610524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.610624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.610844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611003 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611508 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.611932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.612136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.612238 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.612445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.612545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.612756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.612858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.613073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.613163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.613402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.613487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.613806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614374 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.614781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615002 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615746 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.615966 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.616077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.616275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.616367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.616590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.616683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.616904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617003 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617213 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.617933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.618153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.618257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.618464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.618553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.618771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.618867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.619084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.619183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.619429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.619523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.619748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.619840 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620063 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.620989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.621095 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.621300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.621423 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.621605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.621702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.621915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622269 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.622990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.623253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.623363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.623541 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.623635 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.623858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.623947 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.624167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.624327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.624504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.624602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.624782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.624895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.625090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.625191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.625400 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.625521 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.625711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.625804 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626116 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626336 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.626955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.627045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.627286 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.627395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.627614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.627705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.627922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628333 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.628938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.629152 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.629283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.629463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.629555 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.629767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.629859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.630994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.631087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.631329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.631424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.631647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.631747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.631964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.632057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.632277 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.632376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.632588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.632689 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.632906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633227 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633863 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.633952 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.634281 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.634494 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.634596 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.634683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.634833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.634932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.635120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.635234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.635464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.635569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.635776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.635869 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.636098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.636196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.636416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.636672 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.636764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.637015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.637132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.637324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.637424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.637650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.640597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641131 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641592 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641878 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.641971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.642953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643594 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.643823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644344 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644554 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644648 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.644963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645380 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645674 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645889 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.645981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.646198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.646290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.646507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.646598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.646854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.646953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.647167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.647299 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.647535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.647635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.647873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.647972 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.648197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.648298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.648519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.648685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.648831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.648930 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.649150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.649250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.649461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.649552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.649772 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.649876 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.650080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.650182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.650402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.650505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.650703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.650796 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.651986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.652086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.652301 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.652393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.652613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.652723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.652933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.653034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.653242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.653333 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.653657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.653754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.653976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.654069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.654288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.654387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.654601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.654726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.654922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.655040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.655252 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.655458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.655566 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.655782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.655877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.656105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.656197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.656438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.656537 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.656769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.656869 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.657076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.657167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.657387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.657479 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.657703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.657806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658751 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.658953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.659047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.659284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.659399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.659595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.659701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.659909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660531 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.660945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.661174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.661276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.661498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.661590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.661806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.661906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.662121 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.662214 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.662432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.662526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.662740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.662839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.663055 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.663149 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.663392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.663486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.663700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.663792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664864 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.664966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665344 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665730 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.665965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.666173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.666266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.666485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.666589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.666792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.666883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.667121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.667284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.667465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.667569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.667793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.667894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.668114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.668212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.668425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.668530 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.668746 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.668839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.669601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.669703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.669912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.670938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.671165 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.671289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.671500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.671595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.671811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.671901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.672138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.672220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.672458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.672557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.672774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.672875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.673102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.673202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.673434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.673544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.673758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.673850 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.674067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.674165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.674384 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.674522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.674704 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.674958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675055 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675337 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.675960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.676060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.676274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.676375 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.676591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.676700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.676901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677838 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.677944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.678149 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.678242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.678458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.678557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.678782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.678888 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.679093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.679185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.679427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.679521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.679736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.679915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.680044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.680137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.680361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.680462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.680672 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.680774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.681018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.681136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.681353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.681452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.681683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.681780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.682973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.683067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.683319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.683434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.683631 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.683723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.683949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.684051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.684276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.684383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.684617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.684765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685025 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685132 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685326 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.685942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.686164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.686278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.686484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.686650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.686803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.686896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.687127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.687251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.687489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.687592 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.687807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.687900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.688123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.688226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.688442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.688544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.688760 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.688853 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.689097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.689203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.689424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.689561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.689756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.689885 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.690100 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.690193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.690424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.690524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.690746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.690839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.691068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.691169 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.691421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.691528 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.691784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.691886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.692099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.692191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.692411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.692502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.692730 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.692823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.693052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.693144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.693373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.693464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.693685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.693785 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694002 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.694961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.695240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.695351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.695452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.695612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.695709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.695916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.696032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.696244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.696347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.696585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.696688 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.697166 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.697262 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.697485 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.697577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.697803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.697905 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.698123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.698207 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.698433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.698652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.698758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.698971 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.699073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.699333 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.699443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.699664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.699766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.699995 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.700089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.700814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.700917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.701127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.701221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.701459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.701552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.701769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.701870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.702077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.702176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.702395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.702488 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.702712 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.702804 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.703024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.703118 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.703361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.703474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.703690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.703803 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.704966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.705160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.705290 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.705514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.705618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.705834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.705935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.706164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.706257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.706494 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.706598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.706914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.707134 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.707257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.707493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.707600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.707808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.707901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.708120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.708212 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.708442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.708548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.708759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.708851 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.709068 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.709168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.709375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.709476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.709688 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.709779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710718 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.710928 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.711972 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.712186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.712286 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.712505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.712598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.712813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.712913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.713121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.713215 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.713431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.713537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.713741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.713832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.714049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.714149 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.714357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.714448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.714700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.714804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.715039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.715145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.715399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.715519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.715734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.715853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.716123 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.716220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.716450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.716551 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.716775 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.716877 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.717085 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.717177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.717397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.717488 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.717720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.717826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718130 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.718993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.719093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.719337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.719434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.719685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.719878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.720217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.720309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.720538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.720639 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.720857 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.720954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.721177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.721281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.721501 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.721608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.721820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.721920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.722133 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.722228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.722444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.722545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.722758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.722850 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.723073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.723172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.723419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.723529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.723736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.723839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724145 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724467 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724772 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.724993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.725109 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.725310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.725437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.725622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.725741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.725936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.726976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.727184 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.727324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.727526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.727621 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.727845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.727944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.728163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.728257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.728483 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.728577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.728799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.728901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.729116 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.729216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.729428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.729526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.729742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.729842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.730057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.730148 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.730371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.730470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.730697 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.730799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.731025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.731122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.731372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.731977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.732205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.732305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.732530 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.732623 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.732937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.733043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.733264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.733357 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.733597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.733728 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.733922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.734032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.734250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.734358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.734580 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.734680 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.734900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.735010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.735263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.735388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.735562 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.735695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.735891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736211 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736627 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.736942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.737163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.737260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.737474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.737557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.737783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.737866 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.738094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.738182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.738409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.738496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.738721 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.738950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.739043 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.739330 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.739424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.739647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.739748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.739959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740575 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.740985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.741195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.741287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.741500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.741594 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.741806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.741906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.742113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.742214 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.742418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.742519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.742725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.742818 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743363 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.743983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.744091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.744291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.744385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.744601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.744692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.744906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.745984 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.746173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.746290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.746482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.746587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.746788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.746882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.747096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.747273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.747474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.747570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.747794 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.747893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.748105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.748205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.748420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.748511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.748759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.748854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.749076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.749169 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.749395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.749495 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.749717 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.749811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.750972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.751072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.751323 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.751437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.751639 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.751738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.751968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.752060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.752292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.752427 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.752617 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.752729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.752937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.753032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.753256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.753359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.753595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.753808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.753917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.754149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.754256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.754481 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.754583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.754820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.754913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.755136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.755276 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.755482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.755574 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.755795 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.755902 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.756110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.756316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.756415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.756646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.756753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.756849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757461 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.757986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.758087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.758301 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.758394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.758615 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.758723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.758929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759374 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759581 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.759997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.760209 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.760301 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.760522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.760625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.760777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 07:02:16.760878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.761142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.761490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.761818 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.762143 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.762463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.763315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.763637 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.763954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.764270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.764587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.764917 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.765253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.765573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.765887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.766317 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.766645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.766972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.767323 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.767643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.767974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.768305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.768628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.768956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.769273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.769612 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.769959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.770293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.770623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.770937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.771265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.771578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.771895 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.772218 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.772533 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.772841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.773151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.773464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.773777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.774083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.774393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.774708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.775019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.775348 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.775659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.775966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.776278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.776585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.776892 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.777204 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.777514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.777822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.778131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.779010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.779353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.779691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.780031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.780352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.780681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.781000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.781328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.781642 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.781969 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.782298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.782618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.782934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.783290 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.783609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.783927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.784245 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.784561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.784881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.785194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.785529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.785866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.786177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.786507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.786836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.787161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.787506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.787825 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.788160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.788476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.788793 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.789105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.789421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.789737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.790059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.790377 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.790691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.791014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.791355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.791688 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.792019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.792334 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.792666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.792997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.793350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.793669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.794611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.794611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.794804 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.795006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.795341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 07:02:16.795586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 07:02:16.824846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Registered counter for database nova_api Oct 17 07:02:16.846042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:16.852692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:16.859290 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO dbcounter [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Registered counter for database nova_api Oct 17 07:02:16.879123 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_db.sqlalchemy.engines [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:16.885536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writer thread running {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:16.909597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.context [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48e99de6-00ec-4832-bccb-b295fdd3a218(cell1) {{(pid=118995) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 07:02:16.913682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:02:16.914161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:02:16.915767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:02:16.916508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:02:16.916961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:02:16.919007 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:02:16.921032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Registered counter for database nova_cell0 Oct 17 07:02:16.925074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Registered counter for database nova_cell1 Oct 17 07:02:16.932259 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:16.938472 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:16.939197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:16.943391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.context [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48e99de6-00ec-4832-bccb-b295fdd3a218(cell1) {{(pid=118996) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 07:02:16.947765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:02:16.948246 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:02:16.949834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:02:16.951150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:02:16.951630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:02:16.953659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:02:16.955678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO dbcounter [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Registered counter for database nova_cell0 Oct 17 07:02:16.959731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO dbcounter [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Registered counter for database nova_cell1 Oct 17 07:02:16.970901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_db.sqlalchemy.engines [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:16.972183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_db.sqlalchemy.engines [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:16.978972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writer thread running {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:16.980291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writer thread running {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:17.085240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:17.094061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Registered counter for database nova_cell0 Oct 17 07:02:17.103846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:17.108439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:17.131650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO dbcounter [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Registered counter for database nova_cell0 Oct 17 07:02:17.139072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_db.sqlalchemy.engines [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 07:02:17.143909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writer thread running {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 07:02:17.433419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 07:02:17.441323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 07:02:17.483973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: WARNING keystonemiddleware.auth_token [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 07:02:17.491599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: WARNING keystonemiddleware.auth_token [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 07:02:17.785190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 07:02:17.791167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-3c64d27f-ea81-45c8-a72d-5ac9cbb250b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 07:02:17.796536 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f0bdad89c0 pid: 118995 (default app) Oct 17 07:02:17.837605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: WARNING keystonemiddleware.auth_token [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 07:02:17.844577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: WARNING keystonemiddleware.auth_token [None req-736e7301-2ff8-4bc5-80a0-adf655892333 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 07:02:17.850004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f0bdad89c0 pid: 118996 (default app) Oct 17 07:02:53.777467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:53.778933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:53.779871 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:53.780695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:55.190588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a49be6e4-d680-45a1-861b-c4254914c96e tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Action: 'create', calling method: .version_select at 0x7f4ace1ab4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1593796275", "metadata": {"Type": "work"}}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a49be6e4-d680-45a1-861b-c4254914c96e tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Request method failure captured: Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 122 Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4dk24fy9IZUYQkusJcmBNKNdPkK5HongFZzs5AGV-UikKXqQs9ZzM8u92yIxXnKAx9cPY6xLOtROSXqUwmqQo6DpALc3rvv63heNg6rckZUi3b36eCBevPDabbRXciDxhoua_aSCwRGy9yT85HQevCEUkeRUll_IRQuocYCu8elvA Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:02:55.198206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c8dd2001d1b4a44ad171b014dcffc68"}]}] Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: de82574fa84a4ef58565cb06f61f7a68 Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1593796275", "metadata": {"Type": "work"}}} Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: Oct 17 07:02:55.200028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1593796275', 'metadata': {'Type': 'work'}}}} Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise error Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:02:55.201003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 07:02:55.202579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 07:02:55.204008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 07:02:55.204008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.205022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a49be6e4-d680-45a1-861b-c4254914c96e tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:02:55.206230 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a49be6e4-d680-45a1-861b-c4254914c96e tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.440232 Oct 17 07:02:55.207287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 17 07:02:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1443 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:02:55.686075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-55816f6c-209a-4fbd-b6bb-31c98a126e87 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Action: 'create', calling method: .version_select at 0x7f4ace259f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1503655258", "metadata": {"Type": "work"}}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-55816f6c-209a-4fbd-b6bb-31c98a126e87 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Request method failure captured: Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 120 Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4dk24fy9IZUYQkusJcmBNKNdPkK5HongFZzs5AGV-UikKXqQs9ZzM8u92yIxXnKAx9cPY6xLOtROSXqUwmqQo6DpALc3rvv63heNg6rckZUi3b36eCBevPDabbRXciDxhoua_aSCwRGy9yT85HQevCEUkeRUll_IRQuocYCu8elvA Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:02:55.706820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c8dd2001d1b4a44ad171b014dcffc68"}]}] Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: de82574fa84a4ef58565cb06f61f7a68 Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1503655258", "metadata": {"Type": "work"}}} Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: Oct 17 07:02:55.708440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1503655258', 'metadata': {'Type': 'work'}}}} Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise error Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi '0' Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:02:55.709356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 07:02:55.710837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 07:02:55.712099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 07:02:55.712099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.712926 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-55816f6c-209a-4fbd-b6bb-31c98a126e87 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:02:55.714016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-55816f6c-209a-4fbd-b6bb-31c98a126e87 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.500711 Oct 17 07:02:55.715994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 17 07:02:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 504 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:02:55.724692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d4b54d3f-d4ee-4f98-9839-e38a5ba76cb1 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Action: 'create', calling method: .version_select at 0x7f4ace1abe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1024041910", "metadata": {"Type": "work"}}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d4b54d3f-d4ee-4f98-9839-e38a5ba76cb1 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Request method failure captured: Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 119 Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4dk24fy9IZUYQkusJcmBNKNdPkK5HongFZzs5AGV-UikKXqQs9ZzM8u92yIxXnKAx9cPY6xLOtROSXqUwmqQo6DpALc3rvv63heNg6rckZUi3b36eCBevPDabbRXciDxhoua_aSCwRGy9yT85HQevCEUkeRUll_IRQuocYCu8elvA Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:02:55.729426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c8dd2001d1b4a44ad171b014dcffc68"}]}] Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: de82574fa84a4ef58565cb06f61f7a68 Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1024041910", "metadata": {"Type": "work"}}} Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: Oct 17 07:02:55.731689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1024041910', 'metadata': {'Type': 'work'}}}} Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise error Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi '' Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:02:55.732474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 07:02:55.733811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 07:02:55.734896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 07:02:55.734896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:55.734896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d4b54d3f-d4ee-4f98-9839-e38a5ba76cb1 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:02:55.734896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d4b54d3f-d4ee-4f98-9839-e38a5ba76cb1 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014056 Oct 17 07:02:55.738175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 17 07:02:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:02:55.748206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-19f03b1f-80b6-4b9d-85b4-1c5befb4492c tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Calling method '.version_select at 0x7f4ace1edaf0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:02:55.805920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:55.807018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:55.807983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:55.808946 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:02:56.353686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-19f03b1f-80b6-4b9d-85b4-1c5befb4492c tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] HTTP exception thrown: Volume tempest-invalid-2010760632 could not be found. Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-19f03b1f-80b6-4b9d-85b4-1c5befb4492c tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Request method failure captured: Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2010760632 HTTP/1.1 Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4dk24fy9IZUYQkusJcmBNKNdPkK5HongFZzs5AGV-UikKXqQs9ZzM8u92yIxXnKAx9cPY6xLOtROSXqUwmqQo6DpALc3rvv63heNg6rckZUi3b36eCBevPDabbRXciDxhoua_aSCwRGy9yT85HQevCEUkeRUll_IRQuocYCu8elvA Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:02:56.359190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c8dd2001d1b4a44ad171b014dcffc68"}]}] Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: de82574fa84a4ef58565cb06f61f7a68 Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Volume tempest-invalid-2010760632 could not be found. Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'tempest-invalid-2010760632'} Oct 17 07:02:56.360562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2010760632 could not be found. (HTTP 404) (Request-ID: req-9f869427-95b3-4ba5-97b2-d0d0511072ed) Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.361350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 07:02:56.362500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2010760632 could not be found. Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:02:56.363662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2010760632 could not be found. Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2010760632 could not be found. Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-19f03b1f-80b6-4b9d-85b4-1c5befb4492c tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Returning 404 to user: Volume tempest-invalid-2010760632 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-19f03b1f-80b6-4b9d-85b4-1c5befb4492c tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2010760632" status: 404 len: 99 microversion: 2.1 time: 0.616791 Oct 17 07:02:56.364779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1218 bytes} [Mon Oct 17 07:02:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2010760632 => generated 99 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 07:02:56.370172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5be1d846-b99d-4428-8b95-d0853aae4d68 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003654 Oct 17 07:02:56.370943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1140 bytes} [Mon Oct 17 07:02:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 07:02:56.381263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-17ef5406-d77f-4888-b355-4af297271065 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004248 Oct 17 07:02:56.382040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1137 bytes} [Mon Oct 17 07:02:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 07:02:56.391416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9eb57849-03c9-41aa-9886-af33acc52701 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Calling method '.version_select at 0x7f4ace0674c0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:02:56.715078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-9eb57849-03c9-41aa-9886-af33acc52701 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] HTTP exception thrown: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9eb57849-03c9-41aa-9886-af33acc52701 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Request method failure captured: Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/os-volumes/ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 HTTP/1.1 Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4dk24fy9IZUYQkusJcmBNKNdPkK5HongFZzs5AGV-UikKXqQs9ZzM8u92yIxXnKAx9cPY6xLOtROSXqUwmqQo6DpALc3rvv63heNg6rckZUi3b36eCBevPDabbRXciDxhoua_aSCwRGy9yT85HQevCEUkeRUll_IRQuocYCu8elvA Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:02:56.720207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c8dd2001d1b4a44ad171b014dcffc68"}]}] Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: de82574fa84a4ef58565cb06f61f7a68 Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7'} Oct 17 07:02:56.721761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. (HTTP 404) (Request-ID: req-690f72f0-2196-4dee-a572-218b7954f53d) Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.722703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 07:02:56.724119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 07:02:56.725405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.726725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9eb57849-03c9-41aa-9886-af33acc52701 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Returning 404 to user: Volume ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:02:56.728403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9eb57849-03c9-41aa-9886-af33acc52701 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7" status: 404 len: 109 microversion: 2.1 time: 0.339115 Oct 17 07:02:56.738328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f7432e2e-7260-44dc-9343-36e2fb2b0240 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Calling method '.version_select at 0x7f4acdf95160>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:02:56.744992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:02:56 2022] DELETE /compute/v2.1/os-volumes/ff89b383-d0b9-4b21-b0fd-e61ccf6e17d7 => generated 109 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:02:56.788586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-f7432e2e-7260-44dc-9343-36e2fb2b0240 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] HTTP exception thrown: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f7432e2e-7260-44dc-9343-36e2fb2b0240 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Request method failure captured: Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/os-volumes/816bf680-e6b7-4a03-90f1-3dab33d29276 HTTP/1.1 Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4dk24fy9IZUYQkusJcmBNKNdPkK5HongFZzs5AGV-UikKXqQs9ZzM8u92yIxXnKAx9cPY6xLOtROSXqUwmqQo6DpALc3rvv63heNg6rckZUi3b36eCBevPDabbRXciDxhoua_aSCwRGy9yT85HQevCEUkeRUll_IRQuocYCu8elvA Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:02:56.790990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9c8dd2001d1b4a44ad171b014dcffc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9c8dd2001d1b4a44ad171b014dcffc68"}]}] Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 9c8dd2001d1b4a44ad171b014dcffc68 Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesNegativeTest-1720901779 Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: de82574fa84a4ef58565cb06f61f7a68 Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesNegativeTest-1720901779-project Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '816bf680-e6b7-4a03-90f1-3dab33d29276'} Oct 17 07:02:56.792462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. (HTTP 404) (Request-ID: req-49b5f03c-41ad-48e0-84f1-6256d413de95) Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.793271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:02:56.794493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 07:02:56.796565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f7432e2e-7260-44dc-9343-36e2fb2b0240 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] Returning 404 to user: Volume 816bf680-e6b7-4a03-90f1-3dab33d29276 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:02:56.799122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f7432e2e-7260-44dc-9343-36e2fb2b0240 tempest-VolumesNegativeTest-1720901779 tempest-VolumesNegativeTest-1720901779-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/816bf680-e6b7-4a03-90f1-3dab33d29276" status: 404 len: 109 microversion: 2.1 time: 0.058789 Oct 17 07:02:56.803641 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:02:56 2022] GET /compute/v2.1/os-volumes/816bf680-e6b7-4a03-90f1-3dab33d29276 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:03:08.682067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-616467925", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:09.099571 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] validate_networks() for [('ce8a5513-da89-4319-af4d-c07814f849c0', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:03:11.330467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:03:11.331089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:03:11.331390 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:03:11.331803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:03:11.332254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:03:11.380563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:11.381075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:11.381511 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:11.382237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:11.382697 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:11.383119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:11.471381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:11.488838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for user c987a5a52fc641f78054ac0218edcd13 and project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:11.515468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:03:11.520656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:03:11.688551 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7818654c-6a2f-4f95-a13a-f00832d5e161 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.714503 Oct 17 07:03:11.689512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 5/9] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:03:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:03:12.075427 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1117432823", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "networks": [{"uuid": "5311f833-fcdd-4362-9461-8a9a7fb862d4"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:12.077155 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bd9979e2-dd45-41a7-8af8-d6a77e85db13 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: .version_select at 0x7f4acdfe9a60>, body: {"keypair": {"name": "tempest-keypair-24946740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtS79afieYL0QbyPQ+nid3FUqG1Auw2PxsdF8ELM24CQnGHMwZXSwQKqOJxzzy8xHbhKBqBkdn9nR5Bcoky0pz3JPemHVRKs1S5JgXcJVa60MZRl+t2x300GJ4uBFVGfA=="}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:12.191369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] validate_networks() for [('5311f833-fcdd-4362-9461-8a9a7fb862d4', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:03:12.248391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-bd9979e2-dd45-41a7-8af8-d6a77e85db13 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'key_pairs'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:12.266768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-bd9979e2-dd45-41a7-8af8-d6a77e85db13 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for user 51b2f292cea24a21928e2adcef0c3786 and project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'key_pairs'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:12.410126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bd9979e2-dd45-41a7-8af8-d6a77e85db13 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.063735 Oct 17 07:03:12.424909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 5/10] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:03:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:03:12.434650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b61a0bd0-2fff-43ae-9dcc-3a83b266c8af tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:12.435459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b61a0bd0-2fff-43ae-9dcc-3a83b266c8af tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:12.802702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b61a0bd0-2fff-43ae-9dcc-3a83b266c8af tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:12.839041 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b61a0bd0-2fff-43ae-9dcc-3a83b266c8af tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1221 microversion: 2.1 time: 0.412321 Oct 17 07:03:12.839660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:12 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1221 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:13.275013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-713293b0-869b-4612-a926-6923ac9e436d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: .version_select at 0x7f4acded43a0>, body: {"keypair": {"name": "tempest-keypair-2046883129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3qUuPLk2ynFXVlIt7z1eeoBJMnWNC5Xg3lqQu6KZw6q6Oi2PWY6qd+MA+hda4XUNPVf1XNMrx+TQmt+O+aCZybal/OEPh7NyTuFU4HPLODI8MsKG0RVJeae2iZW9I77w=="}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:13.323751 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-713293b0-869b-4612-a926-6923ac9e436d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:13.335006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-713293b0-869b-4612-a926-6923ac9e436d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:13.358748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:03:13.360426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:03:13.361300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:03:13.361910 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:03:13.362550 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:03:13.377652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:13.380143 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:13.382398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:13.383281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:13.387886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:13.388837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:13.415549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-713293b0-869b-4612-a926-6923ac9e436d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.574598 Oct 17 07:03:13.417756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 7/12] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:03:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:03:13.437529 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Getting quotas for project b07dcfcb56324cc3a64ade8b763ae573. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:13.438463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1994430243", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:13.445231 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Getting quotas for user 8d144842b98e477aaef275278ad8db7e and project b07dcfcb56324cc3a64ade8b763ae573. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:13.487954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:03:13.490396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:03:13.651874 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-54dc70d9-c009-40df-890c-4608115f2041 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.960247 Oct 17 07:03:13.662809 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 6/13] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:03:13.701974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-17c0a9b6-9e0d-4860-8ea4-1618d188f586 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:13.703826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-17c0a9b6-9e0d-4860-8ea4-1618d188f586 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:13.704623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] validate_networks() for [('ce8a5513-da89-4319-af4d-c07814f849c0', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:03:14.027343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-17c0a9b6-9e0d-4860-8ea4-1618d188f586 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:14.065326 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-17c0a9b6-9e0d-4860-8ea4-1618d188f586 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1215 microversion: 2.1 time: 0.399436 Oct 17 07:03:14.066322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:13 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1215 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:14.968781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:03:14.969531 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:03:14.970013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:03:14.970421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:03:14.970828 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:03:15.011506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:15.012345 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:15.014261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:15.016023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:15.019321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:15.020918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:15.090727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:15.092344 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:15.097283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:15.113941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:15.114307 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:15.115069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for user c987a5a52fc641f78054ac0218edcd13 and project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:15.124948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:15.131741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:15.132464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:15.133035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:15.156170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:03:15.162096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:03:15.284206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cd5dd0b2-f66a-4033-b489-8558d00b35dc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.865152 Oct 17 07:03:15.285091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 8/15] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:03:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:03:15.305634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-254b1cb1-530b-4c41-9592-3b59c55635d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:15.308029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-254b1cb1-530b-4c41-9592-3b59c55635d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:15.404550 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-254b1cb1-530b-4c41-9592-3b59c55635d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:15.412174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-254b1cb1-530b-4c41-9592-3b59c55635d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1222 microversion: 2.1 time: 0.119138 Oct 17 07:03:15.428269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:15 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:15.500512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:15.517969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-69769f35-d389-4919-9cf2-9d9dd2f5c329 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1219 microversion: 2.1 time: 0.432169 Oct 17 07:03:15.522897 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:15 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1219 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:16.390220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1106625070", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4bf4f92-bc76-44e2-bbd3-6f7efc91b1a7"}], "security_groups": [{"name": "tempest-securitygroup--307685963"}], "key_name": "tempest-keypair-24946740", "user_data": "}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:16.444386 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:16.445371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:16.458332 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:16.459125 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:16.461271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:16.462160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:16.464365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:16.468590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:16.594035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:16.605473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e3600e77-9930-453a-b5a2-cab7890bc1bb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1226 microversion: 2.1 time: 0.166975 Oct 17 07:03:16.621434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] validate_networks() for [('c4bf4f92-bc76-44e2-bbd3-6f7efc91b1a7', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:03:16.627273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:16 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:16.633251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:16.633868 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:16.651055 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:16.654994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:16.655712 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:16.656603 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:16.658940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:16.659570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:17.082357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:17.154174 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9644a422-6afc-4cdf-a8e9-94b6946c1d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1219 microversion: 2.1 time: 0.525606 Oct 17 07:03:17.155346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:16 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1219 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:17.636094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:17.638734 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:17.653072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:17.657270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:17.658629 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:17.660503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:17.663700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:17.664323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:17.895397 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:03:17.895950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:03:17.896291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:03:17.897650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:03:17.898309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:03:17.922635 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:17.927277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:17.927797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:17.928608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:17.930947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:17.932421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:17.938992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:17.963567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fc08ec1a-6011-4417-b0d4-5ddf1c34354b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1218 microversion: 2.1 time: 0.332985 Oct 17 07:03:17.968219 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:17 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1218 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:17.978101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:17.989820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for user 51b2f292cea24a21928e2adcef0c3786 and project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:18.004678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:03:18.008458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:03:18.099271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-912720654", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b"}], "security_groups": [{"name": "tempest-securitygroup--1777648569"}], "key_name": "tempest-keypair-2046883129", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:18.176719 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ffc68048-69ac-463e-8cf7-a20c3f2bc18c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.794249 Oct 17 07:03:18.178841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 10/21] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:03:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:03:18.186213 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:18.187368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:18.201658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:18.202527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:18.203846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:18.207012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:18.209025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:18.209806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:18.391014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] validate_networks() for [('27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:03:18.775745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:18.794516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3b92a56b-e62b-4a68-a3b7-52bf9ed8fec3 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1275 microversion: 2.1 time: 0.614191 Oct 17 07:03:18.795667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:18 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1275 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:18.801119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-95f1559e-3cb1-4065-81a6-9430552c3634 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:18.802278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-95f1559e-3cb1-4065-81a6-9430552c3634 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:18.958350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-95f1559e-3cb1-4065-81a6-9430552c3634 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:18.966135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-95f1559e-3cb1-4065-81a6-9430552c3634 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1236 microversion: 2.1 time: 0.169233 Oct 17 07:03:18.966738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:18 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1236 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:18.991767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:18.992497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:19.007093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:19.008622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:19.009173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:19.015591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:19.016198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:19.016747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:19.329272 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:19.377712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6b937d7e-89a6-4fc8-ac75-2f710c6d3579 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1218 microversion: 2.1 time: 0.390702 Oct 17 07:03:19.385459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 13/24] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:18 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1218 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:19.822482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:19.823954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:19.853590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:19.856342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:19.861650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:19.881016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:19.886037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:19.890600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.177419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:20.193308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6f52f17c-0833-4894-8db5-55c0402805db tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1273 microversion: 2.1 time: 0.376250 Oct 17 07:03:20.198055 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:19 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:20.212271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:20.213139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:20.260464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:20.260959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:20.267587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.272349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:20.273517 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:20.275836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.631140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:03:20.631621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:03:20.632061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:03:20.632478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:03:20.632886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:03:20.655736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:20.666477 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-892af6e7-c59f-46fe-8247-0f4e8a3e56d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1288 microversion: 2.1 time: 0.465279 Oct 17 07:03:20.667627 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 15/26] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:20 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1288 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:20.673980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:20.675223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:20.689354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:20.690132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:20.690896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.691866 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:20.692524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:20.693165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.703418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:20.703958 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:20.704404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.705303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:20.705756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:20.708142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:20.759021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:03:20.773283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:03:20.819951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:03:20.822480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:03:20.936449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:20.952957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-466edee7-00e0-4d9e-b622-d46824c5a7e7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1280 microversion: 2.1 time: 0.283707 Oct 17 07:03:20.959897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 16/27] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:20 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:20.999869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-212072ef-08a9-4133-bb53-0c824f04871a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.904978 Oct 17 07:03:21.001079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 12/28] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:03:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 07:03:21.014124 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3857098a-aaf7-4fe2-8511-9481a8943ea5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:21.014765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3857098a-aaf7-4fe2-8511-9481a8943ea5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:21.184198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3857098a-aaf7-4fe2-8511-9481a8943ea5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:21.198148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3857098a-aaf7-4fe2-8511-9481a8943ea5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1241 microversion: 2.1 time: 0.189909 Oct 17 07:03:21.204988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 17/29] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:21 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:21.227241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:21.228121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:21.242810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:21.244158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:21.248738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:21.249737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:21.255534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:21.256701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:21.456888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:21.467112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e522b3d3-5a19-4d8a-8e3a-8fbb396f3429 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1273 microversion: 2.1 time: 0.245830 Oct 17 07:03:21.474031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 13/30] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:21 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:21.704706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:21.705351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:21.717963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:21.721708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:21.722200 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:21.724151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:21.725366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:21.725853 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:21.884766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:21.898205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a59e1343-8a56-48f5-9f12-8e440333bd0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1288 microversion: 2.1 time: 0.197592 Oct 17 07:03:21.900893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 18/31] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:21 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1288 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:21.982542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:21.983274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:21.996488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:21.996994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:21.997438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:21.998162 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:21.998617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:21.999036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.095027 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:22.111121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ef6759a2-bd28-484a-aae7-968d6407a167 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1280 microversion: 2.1 time: 0.132895 Oct 17 07:03:22.112592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 14/32] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:21 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:22.231737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:22.232356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:22.249208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:22.249726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:22.250168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.251595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:22.252076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:22.252638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.394745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:22.406148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c7c6f947-8796-4c17-b350-eff871b369f7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1245 microversion: 2.1 time: 0.178489 Oct 17 07:03:22.424489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 19/33] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:22 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1245 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:22.490128 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:22.490711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:22.519119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:22.519778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:22.520114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.520855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:22.521311 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:22.521737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.923321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:22.924198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:22.933518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:22.934161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:22.934603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.934937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:22.935331 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:22.935965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:22.936529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:22.946668 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f0eb46af-3359-4632-843e-e7c804587a1d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.460384 Oct 17 07:03:22.961437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 15/34] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:22 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:23.085336 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:23.096718 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f82ac647-a1f1-4757-ae51-0c498c729c85 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1288 microversion: 2.1 time: 0.178488 Oct 17 07:03:23.097312 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 20/35] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:22 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1288 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:23.138965 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:23.140009 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:23.147884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:23.148780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:23.149467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:23.154304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:23.155714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:23.156386 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:23.284055 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:23.297272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-78c6c768-021b-4f1b-b8dd-b88390483f5b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1280 microversion: 2.1 time: 0.162245 Oct 17 07:03:23.300132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 16/36] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:23 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:23.432328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:23.434434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:23.444124 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:23.450891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:23.452518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:23.456306 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:23.457301 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:23.458113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:23.644481 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:23.672756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-eb166c21-ac80-4566-973e-c8c02bc9dadd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1245 microversion: 2.1 time: 0.244686 Oct 17 07:03:23.676466 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 21/37] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:23 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1245 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:23.975631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:23.976953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:23.989093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:23.989600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:23.990041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:23.990757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:24.007702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:24.008221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:24.126002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:24.126646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:24.140122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:24.140798 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:24.141254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:24.141992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:24.144679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:24.146463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:24.729976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:24.746552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2e69b81c-bf30-42f1-bd37-4adae4221381 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1288 microversion: 2.1 time: 0.622275 Oct 17 07:03:24.758072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 22/38] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:24 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1288 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:24.783120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:24.785955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:24.836470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:24.839318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:24.841571 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:24.847491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:24.850692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:24.851356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:25.108061 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:25.131821 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1ad42995-1974-4090-ba9b-fe863458561e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1280 microversion: 2.1 time: 0.362120 Oct 17 07:03:25.135290 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 23/39] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:24 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:25.148827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:25.150274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:25.169859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:25.175314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:25.176299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:25.179577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:25.182200 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:25.200855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:25.202492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:25.212425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-76a56a97-830a-4d16-8210-32f3228dc9ad tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 1.242530 Oct 17 07:03:25.225795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 17/40] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:23 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:25.428062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:25.482883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f6a453f0-5f13-48be-ac0e-f6a7e0e37280 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.339380 Oct 17 07:03:25.486325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 24/41] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:25 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:25.788959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:25.789639 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:25.816187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:25.816802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:25.817386 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:25.850787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:25.851952 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:25.853448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:26.162274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:26.162952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:26.171834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:26.177648 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:26.179861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:26.185871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:26.188045 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:26.189547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:26.190154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:26.707613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:26.734973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1f8c31cc-b666-4bf8-b222-f0f42288e10b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.949834 Oct 17 07:03:26.737884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 18/42] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:25 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:26.756483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:26.761169 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:26.782139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:26.783186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:26.784729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:26.787053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:26.788906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:26.790591 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:26.799895 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:26.809451 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-480cc736-d6d5-4bf1-ae0d-fc1bff13178f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.650728 Oct 17 07:03:26.820273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 25/43] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:26 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:26.826383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:26.826998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:26.842156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:26.843048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:26.851901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:26.852804 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:26.853524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:26.854081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:27.016464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:27.048594 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7cc984b6-4504-40a9-9e8e-d94287e9b6ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.224979 Oct 17 07:03:27.068903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 26/44] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:26 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:27.166752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:27.185156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-523e641b-7ce1-45e3-b220-62c4f8ff16e6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.439727 Oct 17 07:03:27.186262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 19/45] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:26 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:27.763992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:27.765639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:27.771728 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:27.772535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:27.773127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:27.773840 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:27.774278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:27.774694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:27.842371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:27.843273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:27.852588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:27.857059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:27.859788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:27.861083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:27.864557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:27.866209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:27.872457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:27.881061 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4c6bf4d5-676d-4a51-9aa5-5c8521eb6ecf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.121379 Oct 17 07:03:27.885606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 27/46] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:27 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:28.075013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=4 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:28.080411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:28.081578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:28.096164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.096873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.097309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.098010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.100774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.101417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.111563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:28.120328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-88e3a167-ce1a-4cc0-8165-b0f384008c6f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.282202 Oct 17 07:03:28.127506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 20/47] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:27 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:28.174285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:28.177974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:28.184092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d5b3e85b-fefd-4d77-bbe8-5e8a2eb548e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.109897 Oct 17 07:03:28.185496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 28/48] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:28 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:28.209315 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:28.210019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:28.220392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.221205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.221869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.222892 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.223650 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.224264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.431106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:28.443416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4562834f-7089-4433-bf10-656c8e8a0489 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.238161 Oct 17 07:03:28.444508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 21/49] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:28 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:28.502379 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5505402-9e11-4dce-bd57-fa7e716f25d8", "tag": "93fe4921-1d65-4c9b-9c82-c6e1fb4146c2"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:28.515066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.515692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.516042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.536601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Creating event network-changed:93fe4921-1d65-4c9b-9c82-c6e1fb4146c2 for instance d5505402-9e11-4dce-bd57-fa7e716f25d8 on hv-cinder-84506 Oct 17 07:03:28.537120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 07:03:28.537511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a523a3ed-b4f5-45a5-9138-3c6185cf84fc req-650150c1-4fac-4cbe-954f-c272643d29d8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 07:03:28.538524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.538971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.539611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.540464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.541341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.542357 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.552632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.compute.rpcapi [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 07:03:28.553525 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] Releasing lock "compute-rpcapi-router" {{(pid=118996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 07:03:28.570122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4141ee4a-09bd-420f-bace-f3799f9ac06c None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189817 Oct 17 07:03:28.571011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 29/50] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:03:28.912394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:28.913098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:28.926382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.926886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.927346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:28.928060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:28.928488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:28.928937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.047334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:29.061567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-338e78e6-eb2f-41cb-a24c-05daff8a21b1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.153697 Oct 17 07:03:29.066276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 22/51] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:28 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:29.146442 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:29.147154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:29.154361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:29.154844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:29.155297 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.158563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:29.167763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:29.168440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.211940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:29.212693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:29.227957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:29.229151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:29.237311 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.238407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:29.239177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:29.239763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.380000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:29.390637 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3d66f7d1-848d-44c9-b07a-6f7e2cb46192 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.183129 Oct 17 07:03:29.393158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 23/52] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:29 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:29.469442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:29.470261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:29.487525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:29.488324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:29.488940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.490174 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:29.493896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:29.494534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:29.537198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:29.541908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:29.546553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-210f75f1-1e42-46f7-9485-a02691217aa0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.405143 Oct 17 07:03:29.551171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 30/53] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:29 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:29.728861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:29.736999 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-725a84f6-210b-4512-8683-6b39cbb6cd90 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.272083 Oct 17 07:03:29.737460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 24/54] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:29 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:30.088847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:30.089456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:30.096622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.097436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.098014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.098910 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.099401 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.099827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.177976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:30.188050 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f8a6f7c8-cc57-4cd7-863d-b349ad9a96fb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.102949 Oct 17 07:03:30.203358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 31/55] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:30 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:30.419516 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:30.421327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:30.429597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.430141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.435524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.436841 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.437486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.438083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.534544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:30.544018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5a5030d9-d0e3-4564-9c53-e5b43f4a9956 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.129158 Oct 17 07:03:30.544609 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 25/56] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:30 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:30.581047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:30.582013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:30.587978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ed23e6-2fa8-4fbb-b1be-2e501f391f74", "tag": "8dc5299c-dfbd-4838-a456-06f29fab46dc"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:30.594195 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.599971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.600937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.601949 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.602907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.603606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.613578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.613578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.634656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.677049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Creating event network-changed:8dc5299c-dfbd-4838-a456-06f29fab46dc for instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 on hv-cinder-84506 Oct 17 07:03:30.677574 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 07:03:30.677988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4675369b-1d2d-4da9-bf67-752965919d40 req-d9a56438-cca3-40ae-a31a-11933a71192d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 07:03:30.686054 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.686525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.686957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.687694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.688137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.688550 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.699189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.compute.rpcapi [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 07:03:30.709462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] Releasing lock "compute-rpcapi-router" {{(pid=118995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 07:03:30.748895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5979b62a-7094-4dff-aa08-1041db0a3d11 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162356 Oct 17 07:03:30.753685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 26/57] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:03:30.779125 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:30.780177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:30.787445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.787817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.788246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.788946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:30.789398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:30.789818 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:30.832984 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=20 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:30.994634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:31.005437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e47ea5fa-525a-4358-8ad1-076a48af0ff8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.428464 Oct 17 07:03:31.015620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 32/58] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:30 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:31.107936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:31.122077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a92df8ea-9cc4-446f-a724-edec52ff5853 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.363606 Oct 17 07:03:31.123392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 27/59] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:30 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:31.220160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:31.221612 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:31.224283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=28 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:31.234354 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:31.236412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:31.237392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:31.238835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:31.239675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:31.240132 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:31.351486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:31.369621 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9382d4c1-ff9e-40bc-b4b1-470188f0580d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.155377 Oct 17 07:03:31.380433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 33/60] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:31 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:31.566983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:31.567628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:31.574274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:31.575045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:31.575685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:31.576572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:31.577196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:31.577791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:31.654900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:31.663475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bfd22ade-139d-42b4-87a7-cf9faacaa3f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.100265 Oct 17 07:03:31.679424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 28/61] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:31 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:32.030094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:32.031049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:32.037253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.037728 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.038156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.038837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.039318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.039726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.161782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:32.163856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:32.180966 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.182911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.184016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.185869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.188094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.190939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.291784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:32.307995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4dcc6271-4a86-4178-b2de-84347484a76f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.282393 Oct 17 07:03:32.319708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 34/62] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:32 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:32.395465 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:32.396178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:32.413123 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.413980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.414543 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.418416 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.419271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.420226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.481075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:32.488780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bbf2da0c-1c70-4db9-9959-85c2ab1f695a tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.346953 Oct 17 07:03:32.489360 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 29/63] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:32 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:32.498025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:32.505896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bbf64890-7599-4ef6-869e-25256ed3d047 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.114981 Oct 17 07:03:32.506461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 35/64] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:32 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:32.688997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:32.689830 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:32.696431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.696921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.697347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.698225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:32.698935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:32.699391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:32.763882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:32.771916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-408359bf-10e7-4a34-9b7c-7497d4d84592 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.087317 Oct 17 07:03:32.772498 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 30/65] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:32 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:33.338776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:33.339440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:33.346352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.347068 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.347535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.348234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.348839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.349417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.483091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:33.491069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1fa5a648-8a7e-4ca2-92dc-65328cdb3ff2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.156875 Oct 17 07:03:33.497230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 36/66] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:33 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:33.512327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:33.515831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:33.519356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:33.523988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.524561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.525111 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.525861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.526374 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.526871 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.528364 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:33.528986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:33.534841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.535360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.535817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.536505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.536959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.537385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.630287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:33.646663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c8c4d8a8-dee1-4619-98d0-d274401c80c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.122446 Oct 17 07:03:33.649328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 37/67] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:33 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:33.709355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:33.717951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f64b7d3c-8069-4987-bcd2-10525f9401e2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.209598 Oct 17 07:03:33.718533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 31/68] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:33 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:33.797601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:33.798271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:33.816994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.817735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.818641 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.819757 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:33.820283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:33.820779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:33.889387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:33.899348 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e7df1114-a26a-407d-92d3-2894acf06ccf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.106217 Oct 17 07:03:33.899944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 38/69] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:33 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:34.514157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:34.514769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:34.520567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.521050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.521509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.522190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.522640 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.523065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.661553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:34.670064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-52e52be9-9a42-4e52-8590-997325b4fb86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.160259 Oct 17 07:03:34.670358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:34.670888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 32/70] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:34 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:34.670964 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:34.677179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.677671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.678106 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.678887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.679557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.680177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.742016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:34.743000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:34.749794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.750362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.750956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.751318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:34.751946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.752549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.753036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.759070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-30541c3e-5657-421c-9164-ff33207c2e96 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.092957 Oct 17 07:03:34.759859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 39/71] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:34 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:34.883823 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:34.896003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7ab50cb2-08e0-423c-8686-ecb4744abb16 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.158498 Oct 17 07:03:34.896570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 33/72] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:34 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:34.921808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:34.922419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:34.928319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.928792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.929223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.929900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:34.930365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:34.930763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:34.992092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:34.999712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-29b577c7-410b-47c2-a163-e5bf887a5e26 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1293 microversion: 2.1 time: 0.081731 Oct 17 07:03:35.000463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 40/73] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:34 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:35.698193 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:35.700853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:35.717619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:35.718544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:35.719240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:35.720961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:35.721424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:35.722296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:35.782231 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:35.783043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:35.792078 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:35.797368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:35.802714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:35.805288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:35.805920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:35.807726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:36.011734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:36.026632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5ca27f55-2d9c-4597-b9fc-2c5a0d3333fd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1294 microversion: 2.1 time: 0.248059 Oct 17 07:03:36.043392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 41/74] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:35 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1294 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:36.048290 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:36.048910 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:36.055542 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:36.056040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:36.056476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:36.057179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:36.057622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:36.058235 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:36.454107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:36.469625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f4ddedd3-0fb3-4038-bf12-49fc49630511 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.774771 Oct 17 07:03:36.470959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 34/75] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:35 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:36.486286 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:36.487227 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:36.503260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:36.503840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:36.504200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:36.504908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:36.505425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:36.505802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:36.646358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:36.657987 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-09b93695-30ad-4c02-831b-79958fd5fa1d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1299 microversion: 2.1 time: 0.185044 Oct 17 07:03:36.659256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 35/76] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:36 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:36.927044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:36.943166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c004682c-bccf-48a3-a295-0e9bc76e5d9d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.898576 Oct 17 07:03:36.945137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 42/77] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:36 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:37.050338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:37.051202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:37.061657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.062158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.062592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.063318 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.063770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.064264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.500510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:37.501183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:37.518897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.519577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.520031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.521357 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.521821 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.522249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.610978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:37.628327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9a3d6d5b-400a-461d-a127-ce79ed1aa1c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.581677 Oct 17 07:03:37.639245 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 36/78] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:37 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:37.682372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:37.683863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:37.694360 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.694855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.695320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.696027 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.696481 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.696908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.890889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:37.910915 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eb244fa4-3d9c-49de-899a-5b50295bfecc tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1299 microversion: 2.1 time: 0.232628 Oct 17 07:03:37.927834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 37/79] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:37 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:37.975552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:37.977238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:37.989237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.991749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.994206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:37.995225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:37.998134 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:37.998832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:38.248724 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:38.271230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d058106f-795b-4b20-a74d-452647945e54 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.776178 Oct 17 07:03:38.273153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 43/80] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:37 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:38.395577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-f9887127-2115-4b54-acf9-eb909bd8de36 req-7d6130f4-977a-476a-b999-2981a4a88665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bd99e6-18f2-46de-bd56-1ddf47ff7204", "tag": "df638f88-4d05-4fe8-b626-15417ca804c5"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:38.409435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-f9887127-2115-4b54-acf9-eb909bd8de36 req-7d6130f4-977a-476a-b999-2981a4a88665 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:38.410168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-f9887127-2115-4b54-acf9-eb909bd8de36 req-7d6130f4-977a-476a-b999-2981a4a88665 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:38.410856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-f9887127-2115-4b54-acf9-eb909bd8de36 req-7d6130f4-977a-476a-b999-2981a4a88665 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:38.430662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-f9887127-2115-4b54-acf9-eb909bd8de36 req-7d6130f4-977a-476a-b999-2981a4a88665 service nova] Creating event network-changed:df638f88-4d05-4fe8-b626-15417ca804c5 for instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 on hv-cinder-84506 Oct 17 07:03:38.432178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:38.441088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-f9887127-2115-4b54-acf9-eb909bd8de36 req-7d6130f4-977a-476a-b999-2981a4a88665 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165427 Oct 17 07:03:38.442548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 44/81] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:03:38.452226 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0fa97007-da5f-4ebc-ba65-8b75580952aa tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.480753 Oct 17 07:03:38.454601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 38/82] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:37 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:38.662843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:38.663860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:38.668715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:38.680806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:38.684490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:38.685158 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:38.686075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:38.686680 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:38.687805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:38.911047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:38.922139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-de20aa69-d5f5-4a0e-aa85-ee60afa4bc34 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.264905 Oct 17 07:03:38.922936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 45/83] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:38 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:38.943756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:38.944953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:38.962931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:38.963532 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:38.964299 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:38.965729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:38.966517 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:38.967731 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.182768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-89549a45-24d5-48f0-9abb-992dc61bb1de req-898ae048-3746-4c03-9872-d8604f381ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69682426-13b0-4029-8721-6832e661201a", "tag": "58de9da1-c7e0-445c-861b-008ae64f8e05"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:39.192437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:39.194220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-89549a45-24d5-48f0-9abb-992dc61bb1de req-898ae048-3746-4c03-9872-d8604f381ba0 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.195041 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-89549a45-24d5-48f0-9abb-992dc61bb1de req-898ae048-3746-4c03-9872-d8604f381ba0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.195715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-89549a45-24d5-48f0-9abb-992dc61bb1de req-898ae048-3746-4c03-9872-d8604f381ba0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.204496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-60451362-2aea-4887-a570-4ad134d36fa0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.265847 Oct 17 07:03:39.205231 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 39/84] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:38 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:39.215567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-89549a45-24d5-48f0-9abb-992dc61bb1de req-898ae048-3746-4c03-9872-d8604f381ba0 service nova] Creating event network-changed:58de9da1-c7e0-445c-861b-008ae64f8e05 for instance 69682426-13b0-4029-8721-6832e661201a on hv-cinder-84506 Oct 17 07:03:39.220565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-89549a45-24d5-48f0-9abb-992dc61bb1de req-898ae048-3746-4c03-9872-d8604f381ba0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038926 Oct 17 07:03:39.220565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 46/85] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:03:39.296431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:39.297157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:39.303489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.304177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.304612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.305350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.305795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.306215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.481454 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:39.482392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:39.486412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:39.492647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.494088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.495073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.495950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.496612 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.496728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2d771e63-307b-4c1d-aaeb-1c9f8656a7ab tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.204354 Oct 17 07:03:39.497352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.503129 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:39.515186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 40/86] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:39 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:39.787932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:39.814723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1d3bad67-0ca0-492e-a1fe-2a9f8ed271bd tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.334369 Oct 17 07:03:39.861122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 47/87] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:39 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:39.950949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:39.951605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:39.957868 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.958409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.958901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.959625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:39.960129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:39.960674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:39.979118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:40.104512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:40.119464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-de6cd368-61cf-4956-be41-f616c259e74f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.177958 Oct 17 07:03:40.155269 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 41/88] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:39 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:40.230221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:40.230842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:40.237049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:40.237741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:40.238318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:40.239145 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:40.239889 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:40.240329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:40.394116 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:40.410870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9aee20a7-7599-4e51-9dc6-e3e7a805845b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.184424 Oct 17 07:03:40.415920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 48/89] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:40 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:40.522689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:40.523887 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:40.532906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:40.533790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:40.534448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:40.535741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:40.536480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:40.537341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:40.697865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=8 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:40.763648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:40.771350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-74ea2b09-0fe3-424d-99ad-04becd1ba681 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.254399 Oct 17 07:03:40.771905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 42/90] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:40 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:40.903419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:40.903419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:40.908254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:40.908736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:40.909164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:40.909854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:40.910299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:40.910715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.074862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:41.083794 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-285e035c-716f-45c1-8497-acafc76242af tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.185822 Oct 17 07:03:41.084567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 49/91] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:40 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:41.154701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:41.155523 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:41.163364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.164065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.164634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.165685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.166376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.167041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.236162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-a853740d-29c2-404b-b6cc-7ec03e729acf req-1a4605cc-c0ab-46a6-beca-ef8683ce306c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca5f24-f6d6-4847-a8b9-d6155ad652db", "tag": "a2219ded-3614-41d2-ada2-7c5864d2d9f4"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:41.264510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a853740d-29c2-404b-b6cc-7ec03e729acf req-1a4605cc-c0ab-46a6-beca-ef8683ce306c service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.265522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a853740d-29c2-404b-b6cc-7ec03e729acf req-1a4605cc-c0ab-46a6-beca-ef8683ce306c service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.266277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a853740d-29c2-404b-b6cc-7ec03e729acf req-1a4605cc-c0ab-46a6-beca-ef8683ce306c service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.282843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-a853740d-29c2-404b-b6cc-7ec03e729acf req-1a4605cc-c0ab-46a6-beca-ef8683ce306c service nova] Creating event network-changed:a2219ded-3614-41d2-ada2-7c5864d2d9f4 for instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db on hv-cinder-84506 Oct 17 07:03:41.290277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-a853740d-29c2-404b-b6cc-7ec03e729acf req-1a4605cc-c0ab-46a6-beca-ef8683ce306c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059076 Oct 17 07:03:41.292353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 50/92] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:03:41.312651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:41.322559 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-48483e39-c4bd-4884-adfe-12639e12243c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.172524 Oct 17 07:03:41.324356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 43/93] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:41 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:41.443841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:41.444785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:41.451858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.452571 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.453396 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.454493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.455035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.455551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.666966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:41.676530 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-07519c12-5659-462d-97bf-26f5bb5b5a81 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.237782 Oct 17 07:03:41.677182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 51/94] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:41 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:41.796033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:41.796553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:41.803766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.804253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.804681 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.805372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:41.805828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:41.806248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:41.957006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:41.964774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dd118e15-4569-4bbf-b65d-4dd711246915 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.173754 Oct 17 07:03:41.979403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 44/95] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:41 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:42.108489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:42.109261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:42.115583 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:42.116224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:42.116602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:42.117291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:42.117735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:42.118327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:42.274211 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:42.282411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4f11356b-4a65-444d-9ab8-436125516642 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.178282 Oct 17 07:03:42.283283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 52/96] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:42 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:42.347982 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:42.348833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:42.354842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:42.356483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:42.357055 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:42.357923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:42.358370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:42.358958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:42.530825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:42.538590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-82de9b99-3415-4d64-a2fb-ece80b2de808 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.194380 Oct 17 07:03:42.539156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 45/97] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:42 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:42.701997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:42.702703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:42.708874 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:42.709388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:42.709819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:42.710510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:42.710962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:42.711409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:42.865479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:42.886151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b969595a-e871-4dfd-8c7d-a4f22a834245 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.189610 Oct 17 07:03:42.888083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 53/98] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:42 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:42.990432 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:42.992607 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:43.006018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.007165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.008098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.026449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.027791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.029754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.293130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:43.304016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ff858587-1eaa-400c-8292-f726472ba298 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.320006 Oct 17 07:03:43.304586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 46/99] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:42 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:43.306455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:43.307074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:43.316351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.318295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.318892 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.319982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.322235 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.322682 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.481045 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:43.502378 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dd648e47-16f6-4b2a-bea0-d53046b59d34 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.200364 Oct 17 07:03:43.516110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 54/100] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:43 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:43.562212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:43.562828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:43.569284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.569766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.570192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.570925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.571350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.571859 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.771105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:43.780789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2383114c-7475-40c8-942c-2e1adc4f9371 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.223227 Oct 17 07:03:43.781382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 47/101] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:43 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:43.910910 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:43.912027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:43.920740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.921819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.922469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:43.923483 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:43.924119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:43.925124 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.164806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:44.174609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4373b2d2-ea11-433f-a446-5216cce853e3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.267423 Oct 17 07:03:44.175462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 55/102] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:43 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:44.328705 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:44.329362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:44.340473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:44.341068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:44.341528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.342264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:44.346120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:44.346621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.526858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:44.528184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:44.535665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:44.536146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:44.536866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.537764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:44.538469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:44.538821 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.552476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:44.578631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-303401bd-f702-4de0-af1b-a696d1fee659 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.254209 Oct 17 07:03:44.592554 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 48/103] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:44 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:44.754562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:44.763929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b9937cff-9d55-4e17-8b92-5634d0d497fb tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.241530 Oct 17 07:03:44.764731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 56/104] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:44 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:44.804271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:44.804866 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:44.811189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:44.811909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:44.812492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.813184 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:44.813631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:44.814050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:44.957940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:44.968146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f13814ac-f50c-486b-a15d-d656b80673ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.167615 Oct 17 07:03:44.968839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 49/105] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:44 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:45.198174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:45.200041 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:45.206510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.207112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:45.207627 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:45.208312 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.208754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:45.209166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:45.370017 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:45.379196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1f2e4ead-7355-4ddb-abb8-b8a40388f17e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.185217 Oct 17 07:03:45.379993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 57/106] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:45 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:45.605879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:45.607536 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:45.616523 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.617012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:45.617503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:45.618204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.618747 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:45.619177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:45.784970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:45.788243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:45.788926 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:45.795934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.796698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:45.797340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:45.797810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c616fcf4-9b0e-4613-8673-bc736dbfe29d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.197372 Oct 17 07:03:45.798403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.798711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 50/107] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:45 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:45.799129 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:45.799745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:45.951816 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:45.962019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e7c5a68b-4bc7-41b7-a693-f3cf3bd0bf81 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.177693 Oct 17 07:03:45.962609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 58/108] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:45 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:45.989885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:45.990500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:45.998863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:45.999795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:46.000493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:46.001872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:46.002323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:46.003238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:46.160714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:46.174825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e1d51ea2-bd5e-453b-a780-e876a00d37df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.188344 Oct 17 07:03:46.184484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 51/109] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:45 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:46.406110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:46.407165 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:46.413383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:46.414245 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:46.414684 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:46.415838 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:46.416291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:46.416873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:46.649385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:46.662448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8eb3c0e6-bc22-4ac0-8560-161dbe037dfe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.262512 Oct 17 07:03:46.663656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 59/110] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:46 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:46.822434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:46.824743 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:46.835767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:46.837738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:46.838411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:46.841371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:46.842070 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:46.843137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:46.986799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:46.988865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:47.001498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:47.002475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:47.003335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:47.005136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:47.005896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:47.006751 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:47.483038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:47.497213 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-64534cfc-f6b0-4b10-84a9-275f5819e130 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.679038 Oct 17 07:03:47.499749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 52/111] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:46 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:47.504899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:47.505756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:47.528409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:47.529152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:47.529586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:47.530442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:47.531421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:47.533824 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:47.536755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:47.540736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-421542c9-f79f-4283-b378-547d2b6cc15f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.559054 Oct 17 07:03:47.541450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 60/112] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:46 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:47.686331 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:47.687031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:47.696926 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:47.698428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:47.700773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:47.702136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:47.702772 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:47.704975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:48.246725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:48.259069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-994bc11e-03c3-4d39-ad72-13ab2d237272 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.756856 Oct 17 07:03:48.259705 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 53/113] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:47 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:48.340273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:48.349453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ec1e6321-c40a-41a7-b69f-4136051b9313 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.667195 Oct 17 07:03:48.354060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 61/114] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:47 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:48.526081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:48.526687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:48.538068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:48.538582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:48.539030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:48.541787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:48.545058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:48.545745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:48.568498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:48.569183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:48.579623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:48.581263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:48.581767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:48.583932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:48.585380 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:48.586765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:48.904871 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:48.915882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-83c1119e-c41c-4634-8f94-84c82a55f31b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.392753 Oct 17 07:03:48.930480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 54/115] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:48 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:48.958341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:48.967136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-16222319-d6b5-401e-aeb7-9418f951ee4b tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.402626 Oct 17 07:03:48.968107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 62/116] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:48 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:49.065329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-d0f1b8af-010e-4f94-ae8b-91a7cb9cf539 req-247c6f2d-e779-49c8-956a-eafed16ecf5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5505402-9e11-4dce-bd57-fa7e716f25d8", "name": "network-vif-plugged", "status": "completed", "tag": "93fe4921-1d65-4c9b-9c82-c6e1fb4146c2"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:49.075825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-d0f1b8af-010e-4f94-ae8b-91a7cb9cf539 req-247c6f2d-e779-49c8-956a-eafed16ecf5e service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.076296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-d0f1b8af-010e-4f94-ae8b-91a7cb9cf539 req-247c6f2d-e779-49c8-956a-eafed16ecf5e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.076821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-d0f1b8af-010e-4f94-ae8b-91a7cb9cf539 req-247c6f2d-e779-49c8-956a-eafed16ecf5e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.088846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-d0f1b8af-010e-4f94-ae8b-91a7cb9cf539 req-247c6f2d-e779-49c8-956a-eafed16ecf5e service nova] Creating event network-vif-plugged:93fe4921-1d65-4c9b-9c82-c6e1fb4146c2 for instance d5505402-9e11-4dce-bd57-fa7e716f25d8 on hv-cinder-84506 Oct 17 07:03:49.097567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-d0f1b8af-010e-4f94-ae8b-91a7cb9cf539 req-247c6f2d-e779-49c8-956a-eafed16ecf5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163095 Oct 17 07:03:49.098755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 55/117] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:03:49.283843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:49.284367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:49.293109 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.293630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.294049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.297345 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.299577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.300654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.383166 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:49.383924 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:49.414804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.415557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.416254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.417038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.417745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.418529 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.528284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:49.552274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fe1cb703-8a64-4fd5-a816-36bb9d1f74d9 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.273266 Oct 17 07:03:49.552861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 63/118] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:49 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:49.623129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:49.636788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-73819582-2d02-4dae-a45e-858e548c79fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.260169 Oct 17 07:03:49.639927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 56/119] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:49 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:49.939891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:49.940507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:49.946805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.947340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.947806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.948541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.949279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.949753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.969578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:49.989769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:49.990379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:49.996699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.997248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.997719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:49.998398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:49.998920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:49.999401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:50.208818 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:50.219176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-86998493-7a88-4149-8137-b39da2c1baba tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.283039 Oct 17 07:03:50.220199 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 64/120] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:49 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:50.223330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:50.245024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ace53aae-5ba4-413b-ad07-84c7cd21036f tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.258933 Oct 17 07:03:50.246146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 57/121] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:49 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:50.576646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:50.577735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:50.588776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:50.589659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:50.590285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:50.593398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:50.594903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:50.595484 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:50.666022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:50.666716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:50.677268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:50.678770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:50.679259 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:50.682117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:50.683031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:50.683670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:50.881022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:50.890257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-65ae8f0e-947f-4020-9acc-148fa53a75c0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.317791 Oct 17 07:03:50.904038 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 65/122] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:50 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:50.923370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:50.927048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:50.932046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bdd94d8c-5620-4f03-aeea-75bd46842b01 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.270288 Oct 17 07:03:50.932607 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 58/123] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:50 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:51.113167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-8e86e1b6-3f89-449a-a493-5ec6ee989596 req-a32f7925-d253-40bd-9a6f-e03b3b7587ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ed23e6-2fa8-4fbb-b1be-2e501f391f74", "name": "network-vif-plugged", "status": "completed", "tag": "8dc5299c-dfbd-4838-a456-06f29fab46dc"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:51.123391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8e86e1b6-3f89-449a-a493-5ec6ee989596 req-a32f7925-d253-40bd-9a6f-e03b3b7587ae service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.123868 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8e86e1b6-3f89-449a-a493-5ec6ee989596 req-a32f7925-d253-40bd-9a6f-e03b3b7587ae service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.124294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8e86e1b6-3f89-449a-a493-5ec6ee989596 req-a32f7925-d253-40bd-9a6f-e03b3b7587ae service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.138454 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-8e86e1b6-3f89-449a-a493-5ec6ee989596 req-a32f7925-d253-40bd-9a6f-e03b3b7587ae service nova] Creating event network-vif-plugged:8dc5299c-dfbd-4838-a456-06f29fab46dc for instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 on hv-cinder-84506 Oct 17 07:03:51.143410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-8e86e1b6-3f89-449a-a493-5ec6ee989596 req-a32f7925-d253-40bd-9a6f-e03b3b7587ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Oct 17 07:03:51.148230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 66/124] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:03:51.241875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:51.242484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:51.249003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.249469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.249908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.250588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.251036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.251486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.271042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:51.271706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:51.278515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.278987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.279440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.280188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.280585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.280997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.447003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:51.455704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9c69e89c-3d88-42f2-9818-f6fedab15643 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.217502 Oct 17 07:03:51.456680 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 59/125] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:51 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:51.461998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:51.470991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4bfa523c-a960-43d4-97f4-4c313ae63dd6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.204801 Oct 17 07:03:51.471733 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 67/126] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:51 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:51.914011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:51.914617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:51.922178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.922888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.923521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.924578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.925337 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.925904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.957329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:51.958217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:51.966707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.974018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.974547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:51.975309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:51.975778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:51.976201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:52.244064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:52.248256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:52.259986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b88f2b26-e8ed-4cd0-80a0-00b3fa035176 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.306841 Oct 17 07:03:52.261429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 68/127] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:51 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:52.271647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1b5715ae-655f-40c9-931e-cfdfc98e20f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.361427 Oct 17 07:03:52.272540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 60/128] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:51 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:52.478379 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:52.479020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:52.485982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:52.486464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:52.486888 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:52.488766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:52.488766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:52.488766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:52.494178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:52.494819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:52.500778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:52.501565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:52.501703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:52.502413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:52.502861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:52.503308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:52.681944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:52.687793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:52.695754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b1efa95e-2868-496f-b5e2-05c8ff364da9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.221022 Oct 17 07:03:52.696337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 69/129] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:52 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:52.701676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c5b0dfd-ceea-4bbb-81a4-2a86ee9cf109 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.211337 Oct 17 07:03:52.702324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 61/130] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:52 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:53.285020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:53.286068 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:53.292890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.294602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.294914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.295567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:53.296008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.296319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:53.296425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.296994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.310121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.310685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.311232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.314046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.314046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.314636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.504898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:53.508494 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:53.513164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4a686922-1569-48a0-8a2d-6de13ddb82c6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.221813 Oct 17 07:03:53.513767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 62/131] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:53 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:53.528669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dd954bd2-327e-41a4-8d36-8e2d6e8c1ae3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.237276 Oct 17 07:03:53.528669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 70/132] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:53 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:53.719095 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:53.719870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:53.725171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:53.725947 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:53.726084 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.726608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.727164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.728046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.728549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.729173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.734393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.734952 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.735528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.736220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:53.736802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:53.737302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:53.940074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:53.947098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:53.947905 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7b312b19-0056-4a8d-b104-6984b99c4143 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.232594 Oct 17 07:03:53.948547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 71/133] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:53 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:53.955600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dd0fef12-329c-4e81-b70c-813bd8538943 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.234612 Oct 17 07:03:53.956160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 63/134] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:53 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:54.547055 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:54.549217 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:54.549955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:54.550570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:54.572086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.573645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.575001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.575112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.575553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.576519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.576929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.577348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.578670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.578912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.579653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.580864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.851143 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:54.854497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:54.862058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c85b76e7-1469-4b0b-ae74-ba061941c9f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.324733 Oct 17 07:03:54.863380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 64/135] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:54 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:54.868039 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-a13af875-9fa5-4ec7-aa59-607d6228b68b req-c77af161-91fa-4fee-932c-c69d3e014c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bd99e6-18f2-46de-bd56-1ddf47ff7204", "name": "network-vif-plugged", "status": "completed", "tag": "df638f88-4d05-4fe8-b626-15417ca804c5"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:03:54.869982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1362ae3d-53e7-4e77-8f02-34f0dd12e52b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.333201 Oct 17 07:03:54.878720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 72/136] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:54 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:54.879858 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a13af875-9fa5-4ec7-aa59-607d6228b68b req-c77af161-91fa-4fee-932c-c69d3e014c94 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.880491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a13af875-9fa5-4ec7-aa59-607d6228b68b req-c77af161-91fa-4fee-932c-c69d3e014c94 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.880933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a13af875-9fa5-4ec7-aa59-607d6228b68b req-c77af161-91fa-4fee-932c-c69d3e014c94 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.902469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-a13af875-9fa5-4ec7-aa59-607d6228b68b req-c77af161-91fa-4fee-932c-c69d3e014c94 service nova] Creating event network-vif-plugged:df638f88-4d05-4fe8-b626-15417ca804c5 for instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 on hv-cinder-84506 Oct 17 07:03:54.908151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-a13af875-9fa5-4ec7-aa59-607d6228b68b req-c77af161-91fa-4fee-932c-c69d3e014c94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043449 Oct 17 07:03:54.908763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 65/137] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:03:54.970975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:54.971943 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:54.978753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:54.979397 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.979594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:54.981276 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.982512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.983807 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.984430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.985189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.986623 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.987332 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.987919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:54.988764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:54.989508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:54.990086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:55.194305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:55.205033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8e42cb6c-723c-4ed5-9e22-6cf383eb5387 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1315 microversion: 2.1 time: 0.230762 Oct 17 07:03:55.206636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 66/138] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:54 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:55.253055 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:55.262226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c3abb11b-2946-4f65-8e65-56c69c0189f5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.295056 Oct 17 07:03:55.263097 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 73/139] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:54 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:55.894456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:55.897669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:55.898303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:55.905347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:55.906035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:55.906691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:55.906945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:55.907876 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:55.908534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:55.909155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:55.914862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:55.916001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:55.916404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:55.917885 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:55.918541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:55.919144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:56.101658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:56.109915 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c18be111-5465-48a4-981a-24aef868388a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.225162 Oct 17 07:03:56.110478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 67/140] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:55 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:56.125932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:56.133692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-70d81611-2c1e-4474-b771-9ca97f49e62a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.243487 Oct 17 07:03:56.134307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 74/141] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:55 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:56.230981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:56.231620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:56.237538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:56.238038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:56.238474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:56.239156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:56.239632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:56.240051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:56.294461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:56.295100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:56.297069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=99 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:03:56.302452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:56.302933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:56.303401 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:56.304110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:56.304558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:56.304976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:56.419921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:56.429082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9981b8d2-5002-4dd7-b15d-bea26272e0bf tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1503 microversion: 2.1 time: 0.202926 Oct 17 07:03:56.435253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 68/142] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:56 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:56.467729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:56.478518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8e2af4ce-5015-4e8c-a171-85eac45dd883 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.188433 Oct 17 07:03:56.479654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 75/143] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:56 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:57.132775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:57.133384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:57.139202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:57.139779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:57.140308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:57.140999 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:57.141475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:57.141901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:57.156239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:57.160877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:57.166764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:57.167768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:57.168207 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:57.168929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:57.169381 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:57.169806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:57.494871 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:57.503168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a894d70f-13fc-4d18-b0c6-b9a26c9857cd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.374134 Oct 17 07:03:57.503771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 69/144] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:57 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:57.507142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:57.508240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:57.508838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:57.514756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:57.515595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c2e4cd5c-f48b-4a12-a058-04d0e541ee68 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.363122 Oct 17 07:03:57.515716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:57.516031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:57.516568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 76/145] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:57 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:57.516779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:57.517370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:57.517801 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:57.648057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:57.655521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4767ba46-952b-4e13-bc9a-89788ab5dd0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.150790 Oct 17 07:03:57.656076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 70/146] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:57 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:58.525960 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:58.526564 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:58.532541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:58.533056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:58.533486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:58.534165 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:58.534605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:58.535019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:58.539047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:58.539678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:58.545585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:58.546064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:58.546501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:58.547175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:58.547660 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:58.548078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:58.721605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:58.729147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9dff12d6-441c-42f5-9859-38f51854dc5f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.207019 Oct 17 07:03:58.730238 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 77/147] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:58 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:58.734602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:58.739278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:58.742957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:58.748375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5b1804cc-7e04-4ed9-8711-b04ec8afdc24 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.213153 Oct 17 07:03:58.748930 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 71/148] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:58 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:03:58.749217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:58.749687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:58.750114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:58.750806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:58.751256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:58.751673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:58.875466 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:58.882915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0c6b4cda-b0f0-4cab-a09b-9739f4fb5bb6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.151726 Oct 17 07:03:58.883844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 78/149] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:58 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:03:59.754534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:59.755184 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:59.761365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:59.761844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:59.762276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:59.762950 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:59.763425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:59.763845 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:59.770925 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:03:59.771702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:03:59.778136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:59.778618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:59.779048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:59.779752 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:03:59.780203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:03:59.780695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:03:59.975710 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:59.980766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:03:59.987126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-62e3ef99-e8a0-4d48-b39e-162d02c4a055 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.236292 Oct 17 07:04:00.004271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-36fed569-09cf-450c-b104-8b302b593393 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.236762 Oct 17 07:04:00.015445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 72/150] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:59 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:00.017665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:00.018451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:00.025300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 79/151] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:03:59 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:00.026262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:00.026957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:00.027580 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:00.028413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:00.029001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:00.029581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:00.046651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-e985f22e-a385-476e-823a-91a78aeba68c req-3dd85cc6-9781-44b1-8398-1f07b53fc8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69682426-13b0-4029-8721-6832e661201a", "name": "network-vif-plugged", "status": "completed", "tag": "58de9da1-c7e0-445c-861b-008ae64f8e05"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:00.068883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e985f22e-a385-476e-823a-91a78aeba68c req-3dd85cc6-9781-44b1-8398-1f07b53fc8c0 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:00.073033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e985f22e-a385-476e-823a-91a78aeba68c req-3dd85cc6-9781-44b1-8398-1f07b53fc8c0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:00.073670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e985f22e-a385-476e-823a-91a78aeba68c req-3dd85cc6-9781-44b1-8398-1f07b53fc8c0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:00.108118 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-e985f22e-a385-476e-823a-91a78aeba68c req-3dd85cc6-9781-44b1-8398-1f07b53fc8c0 service nova] Creating event network-vif-plugged:58de9da1-c7e0-445c-861b-008ae64f8e05 for instance 69682426-13b0-4029-8721-6832e661201a on hv-cinder-84506 Oct 17 07:04:00.122299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-e985f22e-a385-476e-823a-91a78aeba68c req-3dd85cc6-9781-44b1-8398-1f07b53fc8c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078334 Oct 17 07:04:00.124031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 80/152] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:04:00.141663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c6ef4e7-2321-4d29-8747-0942ce13d4c7"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:00.158433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:00.168664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:00.169242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:00.169685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:00.170363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:00.170718 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:00.171150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:00.266183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:00.280279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-81a9fb76-063c-4e9e-9e90-adf538afa483 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.268567 Oct 17 07:04:00.295452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 73/153] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:00 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:00.846025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:00.874154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7ebb837e-f66c-43c2-abd3-93a85d01d587 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "POST /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747835 Oct 17 07:04:00.874878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 81/154] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:04:00 2022] POST /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:01.021507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:01.022112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:01.029188 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:01.029700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:01.030130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:01.030972 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:01.031288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:01.031708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:01.034218 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:01.035515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:01.042569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:01.043544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:01.044185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:01.045353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:01.045625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:01.046043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:01.281967 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:01.290226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9c5477c5-e39b-402b-b812-258c7bfc87c5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.260605 Oct 17 07:04:01.291066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 82/155] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:01 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:01.291477 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:01.299806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c59a5523-7d01-4a37-b499-78f6a5959b89 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.282532 Oct 17 07:04:01.300683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 74/156] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:01 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:01.322658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:01.323546 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:01.332621 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:01.333196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:01.333863 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:01.334778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:01.335444 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:01.335848 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:01.509496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:01.517651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1f32fa9e-fca5-4e5e-b80d-6aeb65fee04f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1322 microversion: 2.1 time: 0.212193 Oct 17 07:04:01.518226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 83/157] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:01 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:02.164249 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-44bf5cb5-465a-4224-95f2-589acd1f6f0f req-b2c99ec8-6d98-4ce5-90f2-3159b5334e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca5f24-f6d6-4847-a8b9-d6155ad652db", "name": "network-vif-plugged", "status": "completed", "tag": "a2219ded-3614-41d2-ada2-7c5864d2d9f4"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:02.174006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-44bf5cb5-465a-4224-95f2-589acd1f6f0f req-b2c99ec8-6d98-4ce5-90f2-3159b5334e08 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.174551 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-44bf5cb5-465a-4224-95f2-589acd1f6f0f req-b2c99ec8-6d98-4ce5-90f2-3159b5334e08 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.175033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-44bf5cb5-465a-4224-95f2-589acd1f6f0f req-b2c99ec8-6d98-4ce5-90f2-3159b5334e08 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.186949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-44bf5cb5-465a-4224-95f2-589acd1f6f0f req-b2c99ec8-6d98-4ce5-90f2-3159b5334e08 service nova] Creating event network-vif-plugged:a2219ded-3614-41d2-ada2-7c5864d2d9f4 for instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db on hv-cinder-84506 Oct 17 07:04:02.191903 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-44bf5cb5-465a-4224-95f2-589acd1f6f0f req-b2c99ec8-6d98-4ce5-90f2-3159b5334e08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Oct 17 07:04:02.192498 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 75/158] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:02.313850 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:02.315342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:02.323358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.325407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.326050 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.327013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.327673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.328313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.330399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:02.331256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:02.339012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.339652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.342064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.344202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.344865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.345478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.595281 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:02.602966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4c31b13d-9c4b-4fac-9683-1d7883e60093 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1361 microversion: 2.1 time: 0.292887 Oct 17 07:04:02.603565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 84/159] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:02 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:02.616513 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:02.619296 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:02.632010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.632829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.647638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.648429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.651456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:02.652897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.654075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.655231 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:02.661508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8ef3dd5a-b946-4d8e-8aa1-d1836e2ab9d8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.338052 Oct 17 07:04:02.662115 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 76/160] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:02 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:02.817248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:02.825840 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-42cf611a-5d49-4d46-b15f-0a3532b3a380 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1516 microversion: 2.1 time: 0.217947 Oct 17 07:04:02.826589 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 85/161] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:02 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:02.848661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:02.850965 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:02.857443 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.858077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.859919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.860766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:02.861295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:02.861780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:02.927845 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lazy-loading 'flavor' on Instance uuid c1bd99e6-18f2-46de-bd56-1ddf47ff7204 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:04:03.051800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5fdb5e12-561e-4a54-8cb4-598b4a848f86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204/action" status: 200 len: 32 microversion: 2.1 time: 0.206958 Oct 17 07:04:03.052401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 77/162] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:04:02 2022] POST /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:04:03.062502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:03.062868 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:03.068778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.069250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.069725 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.070351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.070796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.071232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.259656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:03.281552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4499cc62-fe0e-4a55-8de6-7fbcc34b4d32 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.222697 Oct 17 07:04:03.295884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 86/163] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:03 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:03.630679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:03.631847 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:03.640439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=93 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:03.643560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.644652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.646248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.649011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.649797 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.650475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.685918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:03.686836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:03.693517 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.709376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.709376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.709692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.711259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.712014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.875098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:03.895811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ec9148e4-12b1-480c-8666-608afb379cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1547 microversion: 2.1 time: 0.268236 Oct 17 07:04:03.900716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 78/164] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:03 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1547 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:03.922767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:03.923686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:03.932756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.933716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.934413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.935354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:03.936118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:03.936898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:03.942249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:03.954159 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e38d2a00-1a4b-4f8d-9d86-fe45edbf27d2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.273432 Oct 17 07:04:03.968107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 87/165] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:03 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:04.066737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e8e1b7a9-bbc8-4dab-a3bc-090e8d02bba5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150546 Oct 17 07:04:04.075749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 79/166] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:04:03 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:04.317927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:04.318535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:04.325742 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:04.326314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:04.326896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:04.327648 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:04.328112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:04.328551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:04.479935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:04.489312 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dcd414ad-5a39-4915-8256-c4381f453588 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.174985 Oct 17 07:04:04.490089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 88/167] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:04 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:04.978777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:04.979417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:04.986190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:04.986677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:04.987107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:04.987843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:04.988291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:04.988708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:05.143655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:05.152542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f0afbfd6-0983-4eae-83c7-f80d12f903db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1367 microversion: 2.1 time: 0.177579 Oct 17 07:04:05.153412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 80/168] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:04 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:05.517126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:05.518604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:05.527992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:05.528481 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:05.528912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:05.530396 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:05.530853 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:05.531296 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:05.716478 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:05.725417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bca068e6-de7b-4efd-a4c7-1309323b8cc2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.216647 Oct 17 07:04:05.725992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 89/169] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:05 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:05.875988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-70d7d551-6c34-44b5-92e7-1083ff933c9f req-d587d3b8-2e9f-4f93-865c-040a69de6f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69682426-13b0-4029-8721-6832e661201a", "tag": "58de9da1-c7e0-445c-861b-008ae64f8e05"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:05.886621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-70d7d551-6c34-44b5-92e7-1083ff933c9f req-d587d3b8-2e9f-4f93-865c-040a69de6f88 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:05.887292 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-70d7d551-6c34-44b5-92e7-1083ff933c9f req-d587d3b8-2e9f-4f93-865c-040a69de6f88 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:05.887983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-70d7d551-6c34-44b5-92e7-1083ff933c9f req-d587d3b8-2e9f-4f93-865c-040a69de6f88 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:05.902018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-70d7d551-6c34-44b5-92e7-1083ff933c9f req-d587d3b8-2e9f-4f93-865c-040a69de6f88 service nova] Creating event network-changed:58de9da1-c7e0-445c-861b-008ae64f8e05 for instance 69682426-13b0-4029-8721-6832e661201a on hv-cinder-84506 Oct 17 07:04:05.907995 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-70d7d551-6c34-44b5-92e7-1083ff933c9f req-d587d3b8-2e9f-4f93-865c-040a69de6f88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035969 Oct 17 07:04:05.908926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 81/170] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:06.176886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:06.177519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:06.184585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:06.185001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:06.185473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:06.186171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:06.186914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:06.187406 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:06.336167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:06.344948 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dcadd75c-f0c7-469e-ac5a-1640d4f7cf6d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1556 microversion: 2.1 time: 0.172937 Oct 17 07:04:06.345678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 90/171] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:06 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:06.368895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:06.369507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:06.382539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:06.383066 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:06.383537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:06.384257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:06.384714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:06.385142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:06.501183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-498e0eee-2721-402b-ad15-bdd9358b3e36 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136885 Oct 17 07:04:06.501765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 82/172] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:04:06 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:06.748575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:06.749181 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:06.756168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:06.756652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:06.757074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:06.757759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:06.758206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:06.758622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:07.032175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:07.042972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-34a8098d-872a-4c65-acc9-0fa58431f769 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.298031 Oct 17 07:04:07.062167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 91/173] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:06 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:07.927620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-9efba65a-c183-4cf4-8658-7abf72ff9c88 req-ab15b1bb-a3ee-40c7-bf06-b26251ed7d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ca5f24-f6d6-4847-a8b9-d6155ad652db", "tag": "a2219ded-3614-41d2-ada2-7c5864d2d9f4"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:07.938026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9efba65a-c183-4cf4-8658-7abf72ff9c88 req-ab15b1bb-a3ee-40c7-bf06-b26251ed7d99 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:07.938748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9efba65a-c183-4cf4-8658-7abf72ff9c88 req-ab15b1bb-a3ee-40c7-bf06-b26251ed7d99 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:07.939544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9efba65a-c183-4cf4-8658-7abf72ff9c88 req-ab15b1bb-a3ee-40c7-bf06-b26251ed7d99 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:07.954890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-9efba65a-c183-4cf4-8658-7abf72ff9c88 req-ab15b1bb-a3ee-40c7-bf06-b26251ed7d99 service nova] Creating event network-changed:a2219ded-3614-41d2-ada2-7c5864d2d9f4 for instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db on hv-cinder-84506 Oct 17 07:04:07.962533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-9efba65a-c183-4cf4-8658-7abf72ff9c88 req-ab15b1bb-a3ee-40c7-bf06-b26251ed7d99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039262 Oct 17 07:04:07.964404 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 83/174] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:08.066657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:08.067505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:08.074280 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:08.075010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:08.075473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:08.076382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:08.076995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:08.077417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:08.247740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:08.256961 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0ed5f7b0-04ee-4683-871c-cec32fb1d97a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.194485 Oct 17 07:04:08.257669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 92/175] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:08 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:09.281429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:09.282128 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:09.288347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:09.289119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:09.289763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:09.290478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:09.291066 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:09.291517 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:09.521303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:09.530623 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fd610bfe-9481-4c62-8ce7-35a492d1df72 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.253505 Oct 17 07:04:09.531222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 84/176] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:09 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:10.553811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:10.554347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:10.560911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:10.561588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:10.562018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:10.562697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:10.563142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:10.563581 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:10.707919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:10.717587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8c483851-be88-4c4a-a4a6-fbeaea8fd5b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.167326 Oct 17 07:04:10.723342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 93/177] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:10 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:11.743841 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:11.745189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:11.755067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:11.756129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:11.757064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:11.757919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:11.758476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:11.759064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:11.912586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:11.921501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-00471d86-c611-4495-b9de-27dd9e91c895 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.182273 Oct 17 07:04:11.922282 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 85/178] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:11 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:12.944568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:12.945181 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:12.953246 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:12.953823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:12.954458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:12.956248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:12.957136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:12.957643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:13.096330 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:13.105628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ebf82a19-baea-49aa-b300-4faf9da3c92f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.164772 Oct 17 07:04:13.106403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 94/179] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:12 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:14.129460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:14.129977 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:14.136444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:14.136942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:14.137372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:14.138049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:14.138496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:14.138940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:14.267167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:14.275549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3bd67a84-89f9-41f5-bcc3-071c0242a801 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.149979 Oct 17 07:04:14.276141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 86/180] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:14 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:15.046173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:15.046673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:15.053160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:15.053643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:15.054077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:15.054765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:15.055241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:15.055677 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:15.083767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:04:15.175652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9647428e-2801-4838-b371-d7eec9bfb5c8 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 204 len: 0 microversion: 2.1 time: 0.133699 Oct 17 07:04:15.176242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 95/181] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:04:15 2022] DELETE /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:04:15.184934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:15.185544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:15.192024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:15.193127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:15.193572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:15.194450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:15.194907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:15.195370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:15.298458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:15.299150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:15.305570 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:15.306229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:15.306705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:15.307642 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:15.308151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:15.308599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:15.313432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:15.330254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:15.338531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0a667782-bebe-439d-a185-b057e30c2090 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1555 microversion: 2.1 time: 0.157834 Oct 17 07:04:15.339776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 87/182] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:15 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:15.449304 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:15.458358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8109b391-27d0-4182-a445-3c7436e77881 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.164210 Oct 17 07:04:15.459190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 96/183] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:15 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:16.361720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:16.362333 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:16.368279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:16.368898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:16.369328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:16.370031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:16.370475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:16.370976 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:16.482781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:16.484057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:16.498685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:16.498685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:16.498685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:16.498685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:16.498999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:16.498999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:16.516569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:16.524939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-15347a59-7bc3-40fc-ae03-cf691ea43a55 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1555 microversion: 2.1 time: 0.167073 Oct 17 07:04:16.525508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 88/184] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:16 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:16.622962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:16.630719 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4b5f22e4-8dda-4a30-b428-6d34b98a4ed7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.152626 Oct 17 07:04:16.631305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 97/185] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:16 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:17.548871 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:17.549507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:17.555396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:17.555877 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:17.556308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:17.556991 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:17.557561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:17.558406 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:17.653901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:17.654567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:17.660870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:17.661643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:17.662149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:17.663090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:17.663605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:17.664159 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:17.687490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:17.696612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-435b991c-506a-4a04-b9b3-1dbbe9fd56d6 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1555 microversion: 2.1 time: 0.151435 Oct 17 07:04:17.697432 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 89/186] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:17 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:17.820308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:17.830064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7b99a5c7-d481-4b89-a8f4-eb17d7534117 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.181061 Oct 17 07:04:17.830647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 98/187] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:17 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:18.607598 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-62e0700a-523c-4ee8-85ae-7406d63fd0d2 req-733d23e6-5242-44b0-8d5e-7798f36c97c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5505402-9e11-4dce-bd57-fa7e716f25d8", "name": "network-vif-deleted", "tag": "93fe4921-1d65-4c9b-9c82-c6e1fb4146c2"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:18.617344 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-62e0700a-523c-4ee8-85ae-7406d63fd0d2 req-733d23e6-5242-44b0-8d5e-7798f36c97c9 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:18.617818 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-62e0700a-523c-4ee8-85ae-7406d63fd0d2 req-733d23e6-5242-44b0-8d5e-7798f36c97c9 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:18.618264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-62e0700a-523c-4ee8-85ae-7406d63fd0d2 req-733d23e6-5242-44b0-8d5e-7798f36c97c9 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:18.630934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-62e0700a-523c-4ee8-85ae-7406d63fd0d2 req-733d23e6-5242-44b0-8d5e-7798f36c97c9 service nova] Creating event network-vif-deleted:93fe4921-1d65-4c9b-9c82-c6e1fb4146c2 for instance d5505402-9e11-4dce-bd57-fa7e716f25d8 on hv-cinder-84506 Oct 17 07:04:18.636701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-62e0700a-523c-4ee8-85ae-7406d63fd0d2 req-733d23e6-5242-44b0-8d5e-7798f36c97c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Oct 17 07:04:18.637323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 90/188] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:18.722046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:18.722690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:18.729181 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:18.729689 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:18.730123 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:18.730802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:18.731356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:18.731780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:18.792920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:18.801156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-71fa0032-c1e4-4368-b993-e86f7d014b83 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1346 microversion: 2.1 time: 0.083050 Oct 17 07:04:18.801880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 99/189] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:18 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:18.853315 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:18.854015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:18.860760 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:18.861241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:18.861673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:18.862355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:18.862810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:18.863315 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:19.005093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:19.015699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bef00e89-1660-4186-86f5-474a36b04734 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.166484 Oct 17 07:04:19.023241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 91/190] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:18 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:19.824911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:19.825452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:19.832865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:19.833345 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:19.833788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:19.834448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:19.834893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:19.835335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:19.870411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:19.870909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:19.871349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:19.871797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lazy-loading 'fault' on Instance uuid d5505402-9e11-4dce-bd57-fa7e716f25d8 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:04:19.919330 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d144842b98e477aaef275278ad8db7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07dcfcb56324cc3a64ade8b763ae573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:19.927595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-40d2a568-3026-482c-9375-028b1931148d tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 200 len: 1351 microversion: 2.1 time: 0.107177 Oct 17 07:04:19.928152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 100/191] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:19 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:20.038882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:20.039509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:20.045828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:20.046300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:20.046726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:20.047420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:20.047864 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:20.048274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:20.177566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:20.188285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fbc02b73-73f9-4001-8ad2-a83e6ffdd3d4 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.152642 Oct 17 07:04:20.188874 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 92/192] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:20 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:20.957745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:20.958971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:20.965801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:20.966406 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:20.966909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:20.967871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:20.968394 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:20.968894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:20.987873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] HTTP exception thrown: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Request method failure captured: Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 HTTP/1.1 Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4uqjjgsKKWuMMFU8WmS8yzGE4V-8oTnR2MUKHJ_HEri-xvZ9jES1qJh7FA5uD4BJFNM2mB38U_ooz0gHmsuGyv6GKuTrFlDcuIU3BQoUlTFMf4gNeN_8JZ9zyMHhSlBK-52P505BKJv1h-O1VodmJvnzm324wmacbF8slN1QqU_rk Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:04:20.992907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07dcfcb56324cc3a64ade8b763ae573"}]}] Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 8d144842b98e477aaef275278ad8db7e Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:20.994502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'd5505402-9e11-4dce-bd57-fa7e716f25d8'} Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:04:20.996012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:20.998039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:04:20.999729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Returning 404 to user: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:04:20.999729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-544daa40-2f47-4a9c-8370-ff71f3c7a469 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 404 len: 111 microversion: 2.1 time: 0.040943 Oct 17 07:04:20.999729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 101/193] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:20 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:04:21.133177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:21.136016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:21.144692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:21.145308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:21.146015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:21.146898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:21.147471 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:21.148135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:21.173549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] HTTP exception thrown: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Request method failure captured: Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8/os-volume_attachments HTTP/1.1 Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4uqjjgsKKWuMMFU8WmS8yzGE4V-8oTnR2MUKHJ_HEri-xvZ9jES1qJh7FA5uD4BJFNM2mB38U_ooz0gHmsuGyv6GKuTrFlDcuIU3BQoUlTFMf4gNeN_8JZ9zyMHhSlBK-52P505BKJv1h-O1VodmJvnzm324wmacbF8slN1QqU_rk Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:04:21.178593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07dcfcb56324cc3a64ade8b763ae573"}]}] Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d144842b98e477aaef275278ad8db7e Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:21.179994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'server_id': 'd5505402-9e11-4dce-bd57-fa7e716f25d8'} Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:04:21.180673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:21.181737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:21.183889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Returning 404 to user: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:04:21.183889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-40b95be3-4fe3-4e0c-8688-b626edbfa6cc tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051555 Oct 17 07:04:21.183889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 93/194] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:04:21 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:04:21.214236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:21.216011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:21.223337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:21.225774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:21.226407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:21.227721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:21.228476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:21.229773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:21.446497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:21.459819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0479871f-ba36-431d-b8c5-d6a61c88a4ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.249291 Oct 17 07:04:21.459819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 102/195] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:21 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:22.445700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:22.446184 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:22.452605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:22.453040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:22.453480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:22.454181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:22.454630 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:22.455072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:22.469461 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] HTTP exception thrown: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Request method failure captured: Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 HTTP/1.1 Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4uqjjgsKKWuMMFU8WmS8yzGE4V-8oTnR2MUKHJ_HEri-xvZ9jES1qJh7FA5uD4BJFNM2mB38U_ooz0gHmsuGyv6GKuTrFlDcuIU3BQoUlTFMf4gNeN_8JZ9zyMHhSlBK-52P505BKJv1h-O1VodmJvnzm324wmacbF8slN1QqU_rk Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:04:22.471661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07dcfcb56324cc3a64ade8b763ae573"}]}] Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d144842b98e477aaef275278ad8db7e Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.473092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'd5505402-9e11-4dce-bd57-fa7e716f25d8'} Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:04:22.473875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.475151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.477560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Returning 404 to user: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:04:22.483255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:22.484230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:22.487478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3bf12a67-760a-49a2-b878-88682f8ddcc2 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 404 len: 111 microversion: 2.1 time: 0.031285 Oct 17 07:04:22.494288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:22.494815 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:22.495268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:22.495964 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:22.496418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:22.496838 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:22.501964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 94/196] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:04:22 2022] DELETE /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:04:22.505836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:22.506453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] [instance: d5505402-9e11-4dce-bd57-fa7e716f25d8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:22.512455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:22.512941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:22.513369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:22.514150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:22.514552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:22.514963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:22.532657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] HTTP exception thrown: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Request method failure captured: Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 HTTP/1.1 Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4uqjjgsKKWuMMFU8WmS8yzGE4V-8oTnR2MUKHJ_HEri-xvZ9jES1qJh7FA5uD4BJFNM2mB38U_ooz0gHmsuGyv6GKuTrFlDcuIU3BQoUlTFMf4gNeN_8JZ9zyMHhSlBK-52P505BKJv1h-O1VodmJvnzm324wmacbF8slN1QqU_rk Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:04:22.534180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07dcfcb56324cc3a64ade8b763ae573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07dcfcb56324cc3a64ade8b763ae573"}]}] Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: b07dcfcb56324cc3a64ade8b763ae573 Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1766314735 Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d144842b98e477aaef275278ad8db7e Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-DeleteServersTestJSON-1766314735-project Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.535683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'd5505402-9e11-4dce-bd57-fa7e716f25d8'} Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:04:22.536490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. Oct 17 07:04:22.538082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:04:22.540503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] Returning 404 to user: Instance d5505402-9e11-4dce-bd57-fa7e716f25d8 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:04:22.540503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-946bc2bf-e5f2-4c3f-9088-0cb380caec88 tempest-DeleteServersTestJSON-1766314735 tempest-DeleteServersTestJSON-1766314735-project] 10.222.0.36 "GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8" status: 404 len: 111 microversion: 2.1 time: 0.033495 Oct 17 07:04:22.540503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 95/197] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:22 2022] GET /compute/v2.1/servers/d5505402-9e11-4dce-bd57-fa7e716f25d8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:04:22.748486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:22.757768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fb82ac37-fa89-44d0-bb8c-b76d07088d3d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.278970 Oct 17 07:04:22.758349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 103/198] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:22 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:23.787539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:23.788221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:23.802062 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:23.802908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:23.804810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:23.805883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:23.806357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:23.806788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:23.813914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:24.430811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:24.472606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e7e4b340-909e-497d-b203-4d48aba70c5a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.689675 Oct 17 07:04:24.473543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 96/199] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:23 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:25.498731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:25.499525 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:25.522475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:25.525007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:25.527399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:25.528437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:25.529081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:25.530274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:25.959714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:25.967476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b45ef231-6861-44a1-b586-001edc1b9c67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.474534 Oct 17 07:04:25.975445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 104/200] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:25 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:26.997129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:26.997809 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:27.006970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:27.010220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:27.010937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:27.012190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:27.013906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:27.014636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:27.361618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:27.373281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0d3f919f-7b08-45c6-87f8-54566f945b0c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.378498 Oct 17 07:04:27.376036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 97/201] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:26 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:28.406661 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:28.407429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:28.409883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:28.415051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:28.415707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:28.416153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:28.417448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:28.417903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:28.418329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:28.556471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:28.564441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c12e7aa6-895a-4712-b3cb-e625e39ebdf0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.161725 Oct 17 07:04:28.565000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 105/202] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:28 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:29.587676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:29.588470 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:29.594687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:29.595000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:29.595454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:29.596318 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:29.596931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:29.597500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:29.830584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:29.853372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8b3eb93c-3624-4836-b8c6-114bd2c5c510 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.268780 Oct 17 07:04:29.855185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 98/203] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:29 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:30.877175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:30.880599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:30.897416 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:30.899852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:30.901894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:30.903675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:30.907773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:30.909028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:31.116550 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:31.138881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-58c4c67f-10a9-492c-910b-af1ad231e21b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.265736 Oct 17 07:04:31.139921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 106/204] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:30 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:32.181759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:32.183035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:32.189076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:32.189755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:32.190368 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:32.191242 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:32.191840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:32.192411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:32.805628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:32.818986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-463ab398-bc0f-44e7-9629-b9f5a9b06bc6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.660797 Oct 17 07:04:32.819608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 99/205] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:32 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:33.859342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:33.859342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:33.872494 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:33.872993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:33.873430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:33.874139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:33.874603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:33.875028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:34.215325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:34.232846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-569473ce-2421-419e-a139-9572e44c5fa6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.381770 Oct 17 07:04:34.233660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 107/206] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:33 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:35.014812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-11627856-b840-42a3-bbfa-f56388115bf7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'create', calling method: .version_select at 0x7f4acd3520d0>, body: {"keypair": {"name": "tempest-keypair-377408679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRw3pr5wgcTzTZmZEIwWRA8ouCJLjK9osdnbyDEEcra5SdQ3Nuv0rPF3nomBvzxE5jbQmcVXbERBTVy0VQK/aWYGJzVT5XDkc3mw7moJJBbYcr0dC9CNyW/GBFKHdMShw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:35.021339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=44 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:35.040474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-11627856-b840-42a3-bbfa-f56388115bf7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for project 721190b4f16142749dda7253941be2c3. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:04:35.045112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-11627856-b840-42a3-bbfa-f56388115bf7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for user 8d404b2974f64aa8a6c32adfc3f7b0bc and project 721190b4f16142749dda7253941be2c3. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:04:35.091419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-11627856-b840-42a3-bbfa-f56388115bf7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.292531 Oct 17 07:04:35.092021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 100/207] 10.222.0.36 () {62 vars in 1200 bytes} [Mon Oct 17 07:04:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 294 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 07:04:35.257909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:35.259138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:35.272785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:35.273604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:35.274236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:35.275053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:35.277539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:35.278193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:35.562513 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:35.576071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-07fed440-0bcb-4850-881b-accee6c8ab8a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.321867 Oct 17 07:04:35.576913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 108/208] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:35 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:36.605918 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:36.606614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:36.614872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:36.615851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:36.616869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:36.618432 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:36.619085 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:36.620412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:37.021865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:37.038174 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b3da4f6b-9dd2-4365-ba63-2b9ece29dd6e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.438742 Oct 17 07:04:37.039839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 101/209] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:36 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:37.715503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1226749391", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0692302f-3838-4656-8053-3d467d585a8b"}], "security_groups": [{"name": "tempest-securitygroup--925057704"}], "key_name": "tempest-keypair-377408679", "user_data": "}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:38.030323 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] validate_networks() for [('0692302f-3838-4656-8053-3d467d585a8b', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:04:38.066047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:38.068081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:38.078896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:38.079668 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:38.080439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:38.082531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:38.083908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:38.084608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:38.544110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:38.563922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a874f6fe-0cbf-4c64-9e94-c70af780b03c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.502540 Oct 17 07:04:38.571263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 102/210] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:38 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:38.880168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:04:38.880684 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:04:38.881138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:04:38.881813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:04:38.882259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:04:38.893008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:38.893878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:38.894679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:38.896233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:38.897314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:38.898012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:38.922842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for project 721190b4f16142749dda7253941be2c3. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:04:38.927561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for user 8d404b2974f64aa8a6c32adfc3f7b0bc and project 721190b4f16142749dda7253941be2c3. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:04:38.939982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:04:38.942651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:04:39.016772 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e327d168-0362-4e7d-9d82-ae82c36d8328 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.306325 Oct 17 07:04:39.017984 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 109/211] 10.222.0.36 () {62 vars in 1188 bytes} [Mon Oct 17 07:04:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 07:04:39.030261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5e11124c-a515-45f1-8f48-29d9e62c5e7d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:39.031594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5e11124c-a515-45f1-8f48-29d9e62c5e7d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:39.113292 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5e11124c-a515-45f1-8f48-29d9e62c5e7d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:39.122212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5e11124c-a515-45f1-8f48-29d9e62c5e7d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:39.124063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5e11124c-a515-45f1-8f48-29d9e62c5e7d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:39.126288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5e11124c-a515-45f1-8f48-29d9e62c5e7d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1281 microversion: 2.20 time: 0.101242 Oct 17 07:04:39.133974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 103/212] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:39 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:39.590109 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:39.591782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:39.602914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:39.604952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:39.608680 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:39.609417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:39.609880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:39.610305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:39.816854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:39.830532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-38296e53-18d0-4f00-8a97-2f795a4d72a9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.245503 Oct 17 07:04:39.831117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 110/213] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:39 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:40.163069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:40.164278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:40.178524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:40.179670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:40.180633 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:40.183064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:40.183939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:40.185426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:40.274137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:40.286384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:40.287893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:40.289011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e6354cb3-4d2d-435e-beae-b613b6a10fd8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1333 microversion: 2.20 time: 0.140471 Oct 17 07:04:40.289870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 104/214] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:40 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:40.856588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:40.858008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:40.866205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:40.866953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:40.867918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:40.869409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:40.870007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:40.870652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:41.039324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:41.047513 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ddd443b1-b3ba-424b-a27a-174075870bc9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.195468 Oct 17 07:04:41.048081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 111/215] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:40 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:41.321205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:41.322067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:41.333011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:41.333646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:41.334373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:41.335383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:41.335852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:41.336284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:41.399728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:41.409370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:41.410916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:41.412370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8fad9f76-1689-48a1-9702-9530b94fad11 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1333 microversion: 2.20 time: 0.098053 Oct 17 07:04:41.413073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 105/216] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:41 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:42.077144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:42.078407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:42.086253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:42.087020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:42.087686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:42.088755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:42.089452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:42.090182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:42.290608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:42.302368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a425d780-ce14-4cd7-b9ab-9a45a8a9810f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1522 microversion: 2.1 time: 0.230379 Oct 17 07:04:42.315657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 112/217] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:42 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:42.442670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:42.443351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:42.449963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:42.450647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:42.451278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:42.452136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:42.452718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:42.453328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:42.530327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:42.538693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:42.540253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:42.542809 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-381cf401-2429-4f1d-81ea-702cb8a46083 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1339 microversion: 2.20 time: 0.105319 Oct 17 07:04:42.543398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 106/218] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:42 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:43.326439 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:43.327070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:43.333783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:43.334480 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:43.334911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:43.335713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:43.336163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:43.336735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:43.524336 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:43.529106 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:43.536891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2650823a-b08b-4238-8cc8-bffa31fe0c1c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1502 microversion: 2.1 time: 0.215328 Oct 17 07:04:43.537669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 113/219] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:43 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:43.564019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:43.565609 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:43.569115 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:43.571619 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:43.585724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:43.587756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:43.588617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:43.590010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:43.590464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:43.591112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:43.591266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:43.591978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:43.592406 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:43.593911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:43.596978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:43.597855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:43.815118 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:43.823438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:43.825155 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:43.826266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-69ac90cd-2357-4925-ac88-87ff6dc917df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.261279 Oct 17 07:04:43.846598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 114/220] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:43 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:43.864082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:43.873237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-64f08c5c-b974-4a14-83e4-75fa742c0a91 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1516 microversion: 2.1 time: 0.316521 Oct 17 07:04:43.883242 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 107/221] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:43 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1516 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:44.422178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-ee03a5ad-f920-44e2-bd68-bfad5b8dc578 req-7025be46-f67a-4e3d-a431-8d9bcf221b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:44.432902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-ee03a5ad-f920-44e2-bd68-bfad5b8dc578 req-7025be46-f67a-4e3d-a431-8d9bcf221b54 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:44.433703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-ee03a5ad-f920-44e2-bd68-bfad5b8dc578 req-7025be46-f67a-4e3d-a431-8d9bcf221b54 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:44.434364 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-ee03a5ad-f920-44e2-bd68-bfad5b8dc578 req-7025be46-f67a-4e3d-a431-8d9bcf221b54 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:44.453608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-ee03a5ad-f920-44e2-bd68-bfad5b8dc578 req-7025be46-f67a-4e3d-a431-8d9bcf221b54 service nova] Creating event network-changed:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:04:44.459683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-ee03a5ad-f920-44e2-bd68-bfad5b8dc578 req-7025be46-f67a-4e3d-a431-8d9bcf221b54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040945 Oct 17 07:04:44.460762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 115/222] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:44.858206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:44.858844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:44.865266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:44.865753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:44.866383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:44.867283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:44.867755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:44.868380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:45.066082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:45.076369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:45.078055 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:45.082605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-db23e255-c866-4d5d-9797-b8df42975ef7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.228296 Oct 17 07:04:45.083862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 108/223] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:44 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:45.398429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:45.401800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:45.408664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:45.409242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:45.409857 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:45.410737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:45.411310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:45.411940 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:45.437406 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lazy-loading 'flavor' on Instance uuid 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:04:45.571575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e977ff06-4a15-4aac-8441-86d79fc9f972 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/action" status: 200 len: 32 microversion: 2.1 time: 0.177822 Oct 17 07:04:45.573138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 116/224] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:04:45 2022] POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:04:45.584661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:45.585467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:45.597397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:45.598337 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:45.599048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:45.602851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:45.603852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:45.604646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:45.879238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:45.889892 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0032ac44-b676-48f6-a023-05116dac3a80 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.311206 Oct 17 07:04:45.890587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 109/225] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:45 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:46.110641 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:46.111366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:46.117460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:46.117942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:46.118368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:46.119051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:46.119652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:46.120294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:46.261491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:46.270673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:46.272335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:46.273541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-29523a56-7226-4989-8ece-234adb694e82 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.167177 Oct 17 07:04:46.274244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 117/226] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:46 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:46.918099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:46.919440 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:46.927406 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:46.928465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:46.928938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:46.929640 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:46.930093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:46.930513 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:47.132466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:47.150232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aed6febe-7bcd-467c-9711-7eca92442fc7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.229451 Oct 17 07:04:47.154342 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 110/227] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:46 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:47.299817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:47.300491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:47.312289 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:47.312788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:47.313219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:47.317928 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:47.319018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:47.321512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:47.716099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:47.728867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:47.730724 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:47.731959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ff1867d7-ab53-4909-a040-880bf0d8394a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.437356 Oct 17 07:04:47.732886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 118/228] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:47 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:48.180897 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:48.182320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:48.189979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:48.190793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:48.191736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:48.192671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:48.193353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:48.193989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:48.446524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:48.454114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-63653778-0ce1-46f0-870f-c6713a143ebd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.278538 Oct 17 07:04:48.454688 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 111/229] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:48 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:48.760990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:48.762161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:48.771786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:48.772546 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:48.774903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:48.776370 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:48.776834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:48.778891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:48.812397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2121354069", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "networks": [{"uuid": "e9aa654f-09bd-4827-bc2e-9633196f1792"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:48.885540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] validate_networks() for [('e9aa654f-09bd-4827-bc2e-9633196f1792', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:04:48.911847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:48.936186 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=6 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:49.120514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:49.373241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:49.390085 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:49.396811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:49.398827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e37c6ad9-c2e8-4fbf-8f55-ebf050eddd84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.641822 Oct 17 07:04:49.401550 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 119/230] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:48 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:49.481206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:49.483104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:49.501536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:49.502476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:49.503142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:49.504105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:49.504789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:49.505424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:49.790158 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:49.801863 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4c803b02-afdd-46f0-ad62-2786ade63cf9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.327730 Oct 17 07:04:49.802874 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 120/231] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:49 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:49.933439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:04:49.933867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:04:49.934343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:04:49.934943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:04:49.935384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:04:49.944486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:49.944972 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:49.945404 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:49.946123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:49.946605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:49.947040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:49.965424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Getting quotas for project 58fdf05cfb044a2aa98bc12a38fb76cd. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:04:49.970075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Getting quotas for user 2e07169459e44b079cbcc5157874c89a and project 58fdf05cfb044a2aa98bc12a38fb76cd. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:04:49.985045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:04:49.987487 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:04:50.047162 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3250523e-60ad-4c6c-8d25-12be059f436a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239480 Oct 17 07:04:50.048339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 112/232] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:04:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:04:50.060201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e7ddf075-c3ae-4c0b-bd1a-b5d0cb8d2af9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:50.061052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e7ddf075-c3ae-4c0b-bd1a-b5d0cb8d2af9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:50.167275 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e7ddf075-c3ae-4c0b-bd1a-b5d0cb8d2af9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:50.174877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e7ddf075-c3ae-4c0b-bd1a-b5d0cb8d2af9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1214 microversion: 2.1 time: 0.118976 Oct 17 07:04:50.191751 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 121/233] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:50 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:50.428976 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:50.430001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:50.438358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:50.439524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:50.440238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:50.441350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:50.443302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:50.443936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:50.447196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-367677740", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:50.563071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] validate_networks() for None {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:04:50.751787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:50.760359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:50.761814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:50.762938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3ffb9dbe-a0f1-4813-880d-263158ed716a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.340115 Oct 17 07:04:50.771159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 113/234] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:50 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:50.829399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:50.830310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:50.841191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:50.842642 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:50.844038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:50.846071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:50.846810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:50.847978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.020267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:04:51.020724 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:04:51.021137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:04:51.021512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:04:51.022086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:04:51.061776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:51.062258 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:51.062911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.065203 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:51.065986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:51.067781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:51.070094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.074824 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-34fc30ba-ef4c-4f44-9e3c-2ca069ec69d1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.252373 Oct 17 07:04:51.076228 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 114/235] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:50 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:51.099784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Getting quotas for project 91958c61267b494aabe3e63a13d6f452. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:04:51.104830 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Getting quotas for user 7a2a6b0ec599444385bde13a429a7ecb and project 91958c61267b494aabe3e63a13d6f452. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:04:51.120720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:04:51.123474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:04:51.190726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-66996f35-67f9-44e5-b11e-838d41befcf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748041 Oct 17 07:04:51.192048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 122/236] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:04:51.204016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fae4fb78-0e7f-487e-84af-56f70136f3a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:51.204633 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fae4fb78-0e7f-487e-84af-56f70136f3a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:51.208424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:51.209883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:51.218547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:51.220532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:51.221486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.222694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:51.223385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:51.224233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.296776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fae4fb78-0e7f-487e-84af-56f70136f3a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:51.306385 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fae4fb78-0e7f-487e-84af-56f70136f3a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1214 microversion: 2.1 time: 0.106289 Oct 17 07:04:51.307717 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 115/237] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:51 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:51.362041 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:51.372360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a34d2538-68e3-49ea-bba7-9522ef8d59b7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1266 microversion: 2.1 time: 0.172420 Oct 17 07:04:51.373901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 123/238] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:51 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:51.796870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:51.797806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:51.811700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:51.812380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:51.813291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.827635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:51.828181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:51.828624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:51.878420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:52.076382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:52.089699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:52.093166 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:52.095322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-48a8e0ea-9ed3-4da2-9e1e-e2c4ac4c5efc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.303052 Oct 17 07:04:52.096265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 116/239] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:51 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:52.104175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:52.104175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:52.116524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.118434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.120671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.122625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-1c48d0a7-6a07-4e93-bc15-b66e145d7735 req-198da8e0-5844-42b5-9a4d-cfdd8cbbe6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "name": "network-vif-plugged", "status": "completed", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:52.123431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.124137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.126080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.162595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-1c48d0a7-6a07-4e93-bc15-b66e145d7735 req-198da8e0-5844-42b5-9a4d-cfdd8cbbe6ca service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.165397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-1c48d0a7-6a07-4e93-bc15-b66e145d7735 req-198da8e0-5844-42b5-9a4d-cfdd8cbbe6ca service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.166635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-1c48d0a7-6a07-4e93-bc15-b66e145d7735 req-198da8e0-5844-42b5-9a4d-cfdd8cbbe6ca service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.196248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-1c48d0a7-6a07-4e93-bc15-b66e145d7735 req-198da8e0-5844-42b5-9a4d-cfdd8cbbe6ca service nova] Creating event network-vif-plugged:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:04:52.213316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-1c48d0a7-6a07-4e93-bc15-b66e145d7735 req-198da8e0-5844-42b5-9a4d-cfdd8cbbe6ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103135 Oct 17 07:04:52.214582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 117/240] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:04:52.370712 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:52.371711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:52.396325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.397034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.398050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.417673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.418726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.419372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.461324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:52.472220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1f3e64d2-3e7b-46b2-bd8b-c5babea79f05 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.377460 Oct 17 07:04:52.487690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 124/241] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:52 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:52.510929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:52.511930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:52.515998 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:52.520306 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.523569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.524018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.524753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:52.524881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-738a22f4-fc07-4e0c-8f9c-440dc7981d75 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1266 microversion: 2.1 time: 0.196239 Oct 17 07:04:52.525729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:52.525990 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 118/242] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:52 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:52.526156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:52.625923 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:52.634092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cd81bcfc-fc0f-4c6c-b530-0623cb475fc9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1272 microversion: 2.1 time: 0.144416 Oct 17 07:04:52.635603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 125/243] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:52 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:53.134205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:53.136613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:53.157229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.159444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.160206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.161385 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.162056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.162661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.382928 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:53.392570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:53.394358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:53.395988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a247500e-efed-46b9-b237-241c4d89f09b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1406 microversion: 2.20 time: 0.277770 Oct 17 07:04:53.396823 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 119/244] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:53 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:53.506086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:53.506952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:53.514345 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.514845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.515516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.516468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.517076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.517698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.549087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:53.549970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:53.557195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.557691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.558122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.558827 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.559304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.559727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.688512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:53.714202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b3652f60-49ba-4140-879c-4d408c376ffd tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1266 microversion: 2.1 time: 0.168886 Oct 17 07:04:53.719704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 120/245] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:53 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:53.731480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:53.731480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:53.743961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.744542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.745029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.746426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:53.746951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:53.747466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:53.893846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:53.903680 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d246eea7-9a2b-4ce3-ae20-880a45f762be tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.401512 Oct 17 07:04:53.904453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 126/246] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:53 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:53.990366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:54.004719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-be05e88c-ff37-46ae-b211-7d3c8e10efd8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.283745 Oct 17 07:04:54.005690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 121/247] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:53 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:54.421228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:54.422790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:54.429284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.430046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.430807 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.432348 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.433019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.433899 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.475420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-f6f91c57-c7bc-4850-aa8e-6bf588546576 req-4454cc16-ad33-4519-97bc-3fc870e2e161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3994e56-480f-4d32-bd42-0e14c2de3327", "tag": "aa085ea1-466f-407a-b1de-7ef44901d65f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:54.504673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-f6f91c57-c7bc-4850-aa8e-6bf588546576 req-4454cc16-ad33-4519-97bc-3fc870e2e161 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.505518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-f6f91c57-c7bc-4850-aa8e-6bf588546576 req-4454cc16-ad33-4519-97bc-3fc870e2e161 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.506173 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-f6f91c57-c7bc-4850-aa8e-6bf588546576 req-4454cc16-ad33-4519-97bc-3fc870e2e161 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.530757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-f6f91c57-c7bc-4850-aa8e-6bf588546576 req-4454cc16-ad33-4519-97bc-3fc870e2e161 service nova] Creating event network-changed:aa085ea1-466f-407a-b1de-7ef44901d65f for instance c3994e56-480f-4d32-bd42-0e14c2de3327 on hv-cinder-84506 Oct 17 07:04:54.548334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-f6f91c57-c7bc-4850-aa8e-6bf588546576 req-4454cc16-ad33-4519-97bc-3fc870e2e161 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076686 Oct 17 07:04:54.549524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 122/248] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:04:54.751354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:54.752122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:54.757414 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:54.772409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:54.774263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:54.778229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-35cf93c7-30e6-4b1b-9970-c0e43b6ed909 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1597 microversion: 2.20 time: 0.361025 Oct 17 07:04:54.780787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.781526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.781832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 127/249] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:04:54 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1597 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:04:54.782438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.783619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.784366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.785000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.811312 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:54.811813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:54.831202 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.831608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.832042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.832916 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:54.833524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:54.834098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:54.986132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:55.005911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2a940892-665e-4c2c-a193-19d92667e613 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1274 microversion: 2.1 time: 0.260729 Oct 17 07:04:55.010800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 123/250] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:54 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1274 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:55.026796 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:55.027488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:55.061057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:55.063806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:55.064269 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:55.068677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:55.070493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:55.070963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:55.080366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c8c6d488-80a5-428a-ae67-f950456b78bd tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.273915 Oct 17 07:04:55.081723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 128/251] 10.222.0.36 () {60 vars in 1316 bytes} [Mon Oct 17 07:04:54 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 07:04:55.086734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:55.088185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:55.111891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:55.114934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:55.116888 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:55.119365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:55.122410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:55.123647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:56.052201 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:56.065943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-609e0b2f-063f-425a-a6c2-a1daba5f4348 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 1.052410 Oct 17 07:04:56.071108 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 124/252] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:55 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:56.075487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:56.078251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:56.078872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:56.093266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:56.098188 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:56.098835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:56.099763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:56.100375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:56.100956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:56.102311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-acb510b0-7c7e-4de0-b79e-6b5e70886aa6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 1.019285 Oct 17 07:04:56.108252 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 129/253] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:55 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:56.583980 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:56.592653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-602c33c5-aa06-4f51-a004-dff78aa19c41 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1272 microversion: 2.1 time: 0.520264 Oct 17 07:04:56.609198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 125/254] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:56 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1272 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:57.095178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:57.096585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:57.110610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:57.111415 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:57.114188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:57.116755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:57.117435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:57.118044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:57.131066 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:57.132348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:57.139651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:57.140436 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:57.141052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:57.141941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:57.142577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:57.150486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:57.859544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:57.867306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:57.867473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b7e1c17e-0fad-4a28-999e-b6e5ae76e27a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.777228 Oct 17 07:04:57.868339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 130/255] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:57 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:57.875903 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-55b18b0e-7790-4fee-87ee-f6476b7814b1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.748814 Oct 17 07:04:57.876126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:57.876740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:57.883258 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:57.883734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:57.884166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:57.885385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:57.885835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:57.886255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:57.887926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 126/256] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:57 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:57.890749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:58.227540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:58.250423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cdfa9095-9f1c-434e-a6ed-937d282ed417 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.380541 Oct 17 07:04:58.251042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 131/257] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:57 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:58.536816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-47debb3a-e330-4791-b9eb-9d7ec77c0532 req-335bc19f-d4cc-4465-97a1-e8be9572d113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:58.554137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-47debb3a-e330-4791-b9eb-9d7ec77c0532 req-335bc19f-d4cc-4465-97a1-e8be9572d113 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:58.554854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-47debb3a-e330-4791-b9eb-9d7ec77c0532 req-335bc19f-d4cc-4465-97a1-e8be9572d113 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:58.555477 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-47debb3a-e330-4791-b9eb-9d7ec77c0532 req-335bc19f-d4cc-4465-97a1-e8be9572d113 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:58.574820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-47debb3a-e330-4791-b9eb-9d7ec77c0532 req-335bc19f-d4cc-4465-97a1-e8be9572d113 service nova] Creating event network-changed:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:04:58.582292 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-47debb3a-e330-4791-b9eb-9d7ec77c0532 req-335bc19f-d4cc-4465-97a1-e8be9572d113 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053293 Oct 17 07:04:58.583867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 127/258] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:04:58.892265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:58.893036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:58.895093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:04:58.903538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:58.904365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:58.920831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:58.921335 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:58.923467 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:58.923962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:58.924403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:58.925115 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:58.927413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:58.928348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:58.932616 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:58.933249 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:58.934022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:58.936250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:59.342086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:59.352054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-91a63dea-7531-40dc-9640-f94300f9aecd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.464242 Oct 17 07:04:59.367236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 132/259] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:58 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:04:59.367236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:04:59.367236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:04:59.376423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:59.380222 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:59.380782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:59.381576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:59.382700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:59.383974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:59.384173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:59.397367 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bf38818d-176f-41de-b1cf-a4398a9b37a6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.499769 Oct 17 07:04:59.397963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 128/260] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:58 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:04:59.498443 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-17eef1fa-6a6e-41ff-a745-de9088c2120e req-bfa7de26-7b03-4e1d-a898-c1bfdc40875e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e236fd-c560-4cbb-9cd1-739186d03772", "tag": "299658d0-3138-44dc-bc44-8503301025a9"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:04:59.518097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-17eef1fa-6a6e-41ff-a745-de9088c2120e req-bfa7de26-7b03-4e1d-a898-c1bfdc40875e service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:04:59.518578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-17eef1fa-6a6e-41ff-a745-de9088c2120e req-bfa7de26-7b03-4e1d-a898-c1bfdc40875e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:04:59.519012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-17eef1fa-6a6e-41ff-a745-de9088c2120e req-bfa7de26-7b03-4e1d-a898-c1bfdc40875e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:04:59.544403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-17eef1fa-6a6e-41ff-a745-de9088c2120e req-bfa7de26-7b03-4e1d-a898-c1bfdc40875e service nova] Creating event network-changed:299658d0-3138-44dc-bc44-8503301025a9 for instance 22e236fd-c560-4cbb-9cd1-739186d03772 on hv-cinder-84506 Oct 17 07:04:59.551434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-17eef1fa-6a6e-41ff-a745-de9088c2120e req-bfa7de26-7b03-4e1d-a898-c1bfdc40875e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056688 Oct 17 07:04:59.552352 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 129/261] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:04:59.735897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:04:59.764798 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8cdcc848-4b30-493e-938b-dc8987618452 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.406926 Oct 17 07:04:59.766892 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 133/262] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:04:59 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:00.380766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:00.382156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:00.390451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:00.393131 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:00.393918 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:00.394512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:00.395479 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:00.396092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:00.396674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:00.422028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:00.423647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:00.461571 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:00.462251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:00.463410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:00.464337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:00.465000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:00.472130 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:00.716081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:00.729618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-99b0267f-3277-4aff-a01a-f423d0c8d988 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.352911 Oct 17 07:05:00.730459 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 130/263] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:00 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:00.738065 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:00.746498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f1113f7d-26d0-43b4-8f01-a15cc744beaa tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.328811 Oct 17 07:05:00.747158 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 134/264] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:00 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:00.789983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:00.790621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:00.798324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:00.799078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:00.799556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:00.800347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:00.800736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:00.801153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.023978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:01.033024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cd6a17b2-9b51-4022-8ad2-092d9bf7a523 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.246867 Oct 17 07:05:01.033490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 131/265] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:00 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:01.324970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:01.325743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:01.327802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:01.328577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=8 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:01.334229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:01.334712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:01.335139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.335851 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:01.336407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:01.337069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.362998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-97a3220b-d5c4-4bff-abd6-a41cb313942f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/ips" status: 200 len: 146 microversion: 2.1 time: 0.041796 Oct 17 07:05:01.370373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 135/266] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:05:01 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:01.755047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:01.755822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:01.758637 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=8 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:01.762651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:01.763144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:01.763602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.764297 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:01.764835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:01.765484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.770831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:01.772303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:01.780381 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:01.781142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:01.781851 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.782629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:01.783334 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:01.783987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:01.974673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:01.988146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:01.989857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8d20a71a-4d7e-41e1-ace2-a728400ddd95 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.238564 Oct 17 07:05:01.990446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 132/267] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:01 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:02.002149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-96caae6c-5307-4082-b4b1-f7e1ceb2a4d9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.235185 Oct 17 07:05:02.011031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 136/268] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:01 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:02.059181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:02.059959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:02.066254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:02.066829 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:02.067396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:02.068388 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:02.068917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:02.069442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:02.237622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:02.248920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-12071000-046e-4f18-b1fc-689ba1116d32 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.195436 Oct 17 07:05:02.250330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 133/269] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:02 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:03.013370 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:03.014962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:03.022450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.024052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.025386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.026103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.026868 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.027560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.029247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:03.030522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:03.037164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.037692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.038356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.039361 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.040199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.040893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.289477 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:03.292898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:03.305310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e53100da-a439-4127-95fd-d3c1d176dbac tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.280371 Oct 17 07:05:03.306590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 134/270] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:03 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:03.308853 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7c28b376-995f-4a81-9852-abff81ae8e99 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.299652 Oct 17 07:05:03.309674 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 137/271] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:03 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:03.313252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:03.313994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:03.315037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:03.315675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:03.325399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.326410 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.326620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.327382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.327726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.328471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.328939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.329500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.329697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.330315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.330570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.331182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.362699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-03eaa9bd-2e5b-4ccc-be9a-9a602c71a697 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/ips" status: 200 len: 148 microversion: 2.1 time: 0.054617 Oct 17 07:05:03.363678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 135/272] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:05:03 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/ips => generated 148 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:03.685270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:03.715791 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-83733c28-5684-4764-a660-3ed830f1d62e tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.404729 Oct 17 07:05:03.718573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 138/273] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:03 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:03.786474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25afe28d-fb4a-420f-a83b-2e41e8049f59"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:03.789233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:03.791370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:03.825540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.826378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.827065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.828650 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.833325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.836771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.916188 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:03.928633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-17918e2b-7945-47b9-acc7-6c044a0ec6a8 req-05789046-a3de-4dd3-bf8a-5bc5e0d97183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3994e56-480f-4d32-bd42-0e14c2de3327", "name": "network-vif-plugged", "status": "completed", "tag": "aa085ea1-466f-407a-b1de-7ef44901d65f"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:03.956452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-17918e2b-7945-47b9-acc7-6c044a0ec6a8 req-05789046-a3de-4dd3-bf8a-5bc5e0d97183 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:03.959365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-17918e2b-7945-47b9-acc7-6c044a0ec6a8 req-05789046-a3de-4dd3-bf8a-5bc5e0d97183 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:03.959843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-17918e2b-7945-47b9-acc7-6c044a0ec6a8 req-05789046-a3de-4dd3-bf8a-5bc5e0d97183 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:03.997451 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-17918e2b-7945-47b9-acc7-6c044a0ec6a8 req-05789046-a3de-4dd3-bf8a-5bc5e0d97183 service nova] Creating event network-vif-plugged:aa085ea1-466f-407a-b1de-7ef44901d65f for instance c3994e56-480f-4d32-bd42-0e14c2de3327 on hv-cinder-84506 Oct 17 07:05:04.002985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-17918e2b-7945-47b9-acc7-6c044a0ec6a8 req-05789046-a3de-4dd3-bf8a-5bc5e0d97183 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081203 Oct 17 07:05:04.003638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 139/274] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:04.352424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:04.354311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:04.361529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:04.362381 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:04.363060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:04.364019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:04.364684 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:04.365318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:04.517480 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:04.529254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d55ac63a-f11e-47e1-97b6-0d2e468fdc1e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.180761 Oct 17 07:05:04.530513 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 140/275] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:04 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:04.538162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:04.539687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:04.550022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:04.551947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:04.552623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:04.553500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:04.554105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:04.554774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:04.792608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:04.805199 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-48c27460-9f79-47c5-8b7b-9558b0f35626 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.273252 Oct 17 07:05:04.809345 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 141/276] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:04 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:04.839389 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:04.840432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:04.863454 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:04.864369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:04.865767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:04.869654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:04.872174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:04.872795 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:05.124660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:05.135999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-24a17a93-f9b8-4c5b-847a-6adfc692e3cc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.325259 Oct 17 07:05:05.137149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 142/277] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:04 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:05.169666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31b1347c-5ada-4032-9567-d7ad184f0b1d"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:05.172318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:05.183811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:05.184307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:05.188076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:05.190898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:05.191740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:05.192890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:05.203746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f9d872d4-0ab5-4b8c-ba03-f25eb40d2d99 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.421323 Oct 17 07:05:05.207998 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 136/278] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:05:03 2022] POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-volume_attachments => generated 194 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:05.558913 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:05.560012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:05.570414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:05.571037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:05.571775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:05.573086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:05.573719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:05.574321 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:06.024839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:06.033832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b8d545d4-59d6-4b65-b016-a1f0326c29a1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.480183 Oct 17 07:05:06.051723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 137/279] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:05 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:06.069509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:06.070401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:06.082549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:06.089141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:06.089890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:06.090616 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:06.094367 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:06.095032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:06.325579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:06.333667 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-92894c0a-968b-41bc-8be7-41f966fc835c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1314 microversion: 2.1 time: 0.279212 Oct 17 07:05:06.334256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 138/280] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:06 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:06.339622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:06.343926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:06.367740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:06.368799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:06.369519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:06.370384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:06.370990 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:06.371687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:06.602395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:06.613925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-08e5078d-1b1c-49b9-a1b0-f503d22a3d38 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.277900 Oct 17 07:05:06.617441 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 139/281] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:06 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:06.622803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-7ae14beb-06a7-4910-b7b2-5663e9f779a9 req-cf049057-d447-4146-bcba-e4bfb4fe8ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e236fd-c560-4cbb-9cd1-739186d03772", "name": "network-vif-plugged", "status": "completed", "tag": "299658d0-3138-44dc-bc44-8503301025a9"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:06.633652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7ae14beb-06a7-4910-b7b2-5663e9f779a9 req-cf049057-d447-4146-bcba-e4bfb4fe8ae1 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:06.634584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7ae14beb-06a7-4910-b7b2-5663e9f779a9 req-cf049057-d447-4146-bcba-e4bfb4fe8ae1 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:06.635172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7ae14beb-06a7-4910-b7b2-5663e9f779a9 req-cf049057-d447-4146-bcba-e4bfb4fe8ae1 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:06.651724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-7ae14beb-06a7-4910-b7b2-5663e9f779a9 req-cf049057-d447-4146-bcba-e4bfb4fe8ae1 service nova] Creating event network-vif-plugged:299658d0-3138-44dc-bc44-8503301025a9 for instance 22e236fd-c560-4cbb-9cd1-739186d03772 on hv-cinder-84506 Oct 17 07:05:06.657348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-7ae14beb-06a7-4910-b7b2-5663e9f779a9 req-cf049057-d447-4146-bcba-e4bfb4fe8ae1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038294 Oct 17 07:05:06.662300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 140/282] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:07.060258 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:07.060966 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:07.071195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:07.072813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:07.072813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:07.073588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:07.074093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:07.074525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:07.170339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0a393401-a81d-463e-9778-c7dbbe5b3842 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.030559 Oct 17 07:05:07.171142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 143/283] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:05:05 2022] POST /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 194 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:07.321783 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:07.332988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6b66c5e9-db43-441d-9a8f-281697e80e92 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.277648 Oct 17 07:05:07.339325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 141/284] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:07 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:07.359438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:07.360144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:07.366380 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:07.366858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:07.367315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:07.368014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:07.368994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:07.375615 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:07.539768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:07.550037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6d5a94bb-2902-4356-ab65-62565de8fea1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1498 microversion: 2.1 time: 0.195466 Oct 17 07:05:07.551130 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 144/285] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:07 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:07.639738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:07.640530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:07.647289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:07.648001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:07.648439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:07.649133 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:07.649772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:07.650364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:07.811348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:07.824238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-134884f0-ed61-408d-b5f2-8dbbb00395e4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.188320 Oct 17 07:05:07.825783 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 142/286] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:07 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:08.224757 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:08.225284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.233101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.233336 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.233949 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.234912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.235402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.235834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.266487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:05:08.324105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:08.361877 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:08.363097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.370543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.371632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.372335 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.373271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.373958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.374646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.379967 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-96f55473-808c-41a3-9cab-a75f5c0e1180 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 204 len: 0 microversion: 2.1 time: 0.158560 Oct 17 07:05:08.384722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 145/287] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:05:08 2022] DELETE /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:05:08.395119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:08.396023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.402878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.403410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.403846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.404555 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.405012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.405437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.600640 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:08.614094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04187037-b40a-426b-b17d-6b641b02ab4c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1502 microversion: 2.1 time: 0.254568 Oct 17 07:05:08.615239 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 143/288] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:08 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:08.645826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:08.658573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7a7a407-beb6-49f0-9c59-ae1f42938a0c"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:08.661890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.664487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cf48f298-8d16-44ee-97a9-d798d8c0ef2e tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1504 microversion: 2.1 time: 0.277749 Oct 17 07:05:08.669281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.669552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 146/289] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:08 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:08.670178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.670798 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.671802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.672417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.673000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.702148 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] HTTP exception thrown: Cannot 'attach_volume' instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 while it is in vm_state rescued Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Request method failure captured: Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/os-volume_attachments HTTP/1.1 Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 74 Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4r7ZFOUxuecQz5SIb8HGYdw1dHJnbuuRuX9fTDDNFvYs4HGL4tY3ROExPHc_geC7Pmljq35QkMSJBT_0ep-YASoAmGRloynlaGRjBJzdCz2_mBMyPxmxcmAc2yW5UWS9kbocXA8DnDoT3tfZHbranKFVMWWamczrQ-0YndiwWOG-A Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:05:08.704061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0cb1aa55658342fcaf2f493f51e9faeb"}]}] Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: c987a5a52fc641f78054ac0218edcd13 Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {"volumeAttachment": {"volumeId": "f7a7a407-beb6-49f0-9c59-ae1f42938a0c"}} Oct 17 07:05:08.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Cannot 'attach_volume' instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 while it is in vm_state rescued Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'server_id': '21ed23e6-2fa8-4fbb-b1be-2e501f391f74', 'body': {'volumeAttachment': {'volumeId': 'f7a7a407-beb6-49f0-9c59-ae1f42938a0c'}}} Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:05:08.706414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 while it is in vm_state rescued Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:08.707581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 while it is in vm_state rescued Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Returning 409 to user: Cannot 'attach_volume' instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 while it is in vm_state rescued {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1c534b3a-bd4a-4e80-951a-53215dd514c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060853 Oct 17 07:05:08.708935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 144/290] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:05:08 2022] POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 07:05:08.715726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:08.716338 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.722320 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.722876 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.723441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.724279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.724945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.725673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.803415 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9bfbf0ef-d92a-4a7c-9c08-3cdbe6c11507 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/action" status: 202 len: 0 microversion: 2.1 time: 0.092125 Oct 17 07:05:08.804334 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 147/291] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:05:08 2022] POST /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:05:08.812893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:08.813705 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.820020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.820585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.821097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.822447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.822981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.823512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.851424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:08.852241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:08.859062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.859696 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.860230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:08.861029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:08.861584 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:08.862128 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:09.052755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:09.060071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:09.067264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-91468f8b-9f98-47a0-b69f-38f1a466ca06 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.219029 Oct 17 07:05:09.068670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b025b721-53dd-4bcd-9a57-115d1c9b245e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.259111 Oct 17 07:05:09.068817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 145/292] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:08 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:09.071010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 148/293] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:08 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:09.698420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:09.699028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:09.706156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:09.706649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:09.707092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:09.707787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:09.708396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:09.708969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:09.881611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:09.891495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f35abaf0-fc0a-4c40-9f72-9e36853d4991 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1504 microversion: 2.1 time: 0.197424 Oct 17 07:05:09.892531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 146/294] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:09 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:10.096087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:10.102794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:10.104051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:10.104667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:10.117954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:10.119652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:10.120219 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:10.120718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:10.121184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:10.121958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:10.122488 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:10.123038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:10.123825 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:10.124319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:10.124878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:10.127915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:10.341639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:10.356066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-62d59d8e-e669-4467-ba47-2bb6e9fb82da tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.264199 Oct 17 07:05:10.356835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 149/295] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:10 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:10.373725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:10.385010 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-40e26440-ce27-4045-a0af-f37ebd6dccf1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.287519 Oct 17 07:05:10.385614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 147/296] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:10 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:10.917099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:10.917703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:10.926716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:10.927200 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:10.927647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:10.928342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:10.928789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:10.929202 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:11.071781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:11.080387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-60c937bf-3e3d-4bb5-ab0c-0a563f8487ec tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1504 microversion: 2.1 time: 0.168615 Oct 17 07:05:11.080932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 150/297] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:10 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:11.379651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:11.380726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:11.388250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:11.388949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:11.389565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:11.390259 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:11.390708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:11.391121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:11.410872 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:11.412162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:11.419643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:11.420430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:11.420878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:11.421581 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:11.422033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:11.422451 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:11.609238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:11.617434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fd1f660c-916b-464e-8e02-8b9299677240 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.241785 Oct 17 07:05:11.627852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 148/298] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:11 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:11.642770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:11.651585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-50b503f4-b18d-43ba-8f97-92dbe0c0af1b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1314 microversion: 2.1 time: 0.245824 Oct 17 07:05:11.652470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 151/299] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:11 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:12.104482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:12.105089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:12.112704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:12.113279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:12.113715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:12.114411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:12.114864 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:12.115334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:12.263103 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:12.271411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b93eae40-3f7e-4518-ae7d-71ec6b9dc5d3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1504 microversion: 2.1 time: 0.171309 Oct 17 07:05:12.272155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 149/300] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:12 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:12.642861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:12.643576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:12.664154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:12.666071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:12.668175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:12.671528 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:12.674869 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:12.676440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:12.676805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:12.677653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:12.686628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:12.687608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:12.689316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:12.691346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:12.692211 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:12.696665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.006343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:13.011685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:13.019865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6cdbd7fe-6c67-4818-a8c1-e1eef9d25841 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1463 microversion: 2.1 time: 0.348960 Oct 17 07:05:13.031677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 150/301] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:12 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1463 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:13.039234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2e5394ad-313e-48fd-a084-13c1403ee5e1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.395078 Oct 17 07:05:13.039234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 152/302] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:12 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:13.153973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-51267557-8b9b-4562-a130-1efa270e2801 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:13.167423 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51267557-8b9b-4562-a130-1efa270e2801 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.167917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51267557-8b9b-4562-a130-1efa270e2801 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.168358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51267557-8b9b-4562-a130-1efa270e2801 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.209160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:13.209660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:13.223194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.224201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.237587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.239859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.244396 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.244850 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.326545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:05:13.370803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-51267557-8b9b-4562-a130-1efa270e2801 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Going to try to stop instance {{(pid=118995) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 07:05:13.425436 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:13.464623 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-51267557-8b9b-4562-a130-1efa270e2801 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action" status: 202 len: 0 microversion: 2.1 time: 0.322379 Oct 17 07:05:13.465141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 151/303] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:05:13 2022] POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:05:13.475329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:13.476092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:13.493896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.494447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.494920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.495699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.496167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.496577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.505706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a15d0fc2-d4fd-4900-847b-15f176f77f7b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "DELETE /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 204 len: 0 microversion: 2.1 time: 0.299386 Oct 17 07:05:13.507221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 153/304] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:05:13 2022] DELETE /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:05:13.515628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-966299fb-1be5-4d39-90ba-e4535a51bfea req-5f8b7af2-65f4-4db7-aa7a-ce4036252879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3994e56-480f-4d32-bd42-0e14c2de3327", "name": "network-vif-deleted", "tag": "aa085ea1-466f-407a-b1de-7ef44901d65f"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:13.532881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-966299fb-1be5-4d39-90ba-e4535a51bfea req-5f8b7af2-65f4-4db7-aa7a-ce4036252879 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.533570 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-966299fb-1be5-4d39-90ba-e4535a51bfea req-5f8b7af2-65f4-4db7-aa7a-ce4036252879 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.534722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-966299fb-1be5-4d39-90ba-e4535a51bfea req-5f8b7af2-65f4-4db7-aa7a-ce4036252879 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.549869 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-966299fb-1be5-4d39-90ba-e4535a51bfea req-5f8b7af2-65f4-4db7-aa7a-ce4036252879 service nova] Creating event network-vif-deleted:aa085ea1-466f-407a-b1de-7ef44901d65f for instance c3994e56-480f-4d32-bd42-0e14c2de3327 on hv-cinder-84506 Oct 17 07:05:13.559135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-966299fb-1be5-4d39-90ba-e4535a51bfea req-5f8b7af2-65f4-4db7-aa7a-ce4036252879 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050236 Oct 17 07:05:13.559777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 154/305] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:13.565376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:13.566088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:13.573886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.574387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.575087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.575664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.575882 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.576163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.576264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.576683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.577246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.577717 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid c3994e56-480f-4d32-bd42-0e14c2de3327 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:13.640226 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:13.649309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-47ad2830-4819-4734-af0c-dabf73151c6d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1304 microversion: 2.1 time: 0.182920 Oct 17 07:05:13.650670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 152/306] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:13 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:13.664254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:13.664254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:13.664254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.664254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.664618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.664618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:13.665044 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:13.665494 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:13.799107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:13.807845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-69d6b0d3-b8bb-496d-91be-c663b4516e8b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.246899 Oct 17 07:05:13.808413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 155/307] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:13 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:13.825671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-417faef7-bd54-459b-8600-e456bcdc5618 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Action: 'create', calling method: .version_select at 0x7f4acd43f790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-327178294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLklvIqInN+INS/qkOSZY6s2O5T3G4kdZXbnoBVhcvl/D5CDXWoswDP/e/mZ/qg0zO/GwjgzSxRS9ySpkTj+0KnnZiTIVVQ42Puo9JlAEb6sX2wr7w5wfsgm2VIY1B8WZQ=="}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:13.828878 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:13.836784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8d7b2024-ad67-4b70-bbb6-035fb662e1a5 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1469 microversion: 2.1 time: 0.184548 Oct 17 07:05:13.837908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 153/308] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:13 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:13.841842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-417faef7-bd54-459b-8600-e456bcdc5618 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Getting quotas for project db8098f6f78c49fa843d34d69b002daa. Resources: {'key_pairs'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:13.845625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-417faef7-bd54-459b-8600-e456bcdc5618 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Getting quotas for user c09a31533d7847fea61682ff032f838b and project db8098f6f78c49fa843d34d69b002daa. Resources: {'key_pairs'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:13.866458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-417faef7-bd54-459b-8600-e456bcdc5618 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046021 Oct 17 07:05:13.867039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 156/309] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:05:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:13.918333 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-180365455", "imageRef": "4cb9e3e4-b9a0-4e27-bd7a-1a52f49f13f0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-327178294", "networks": [{"uuid": "f1247dc5-8de6-40d5-83d2-44a721b7542f"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:13.970978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] validate_networks() for [('f1247dc5-8de6-40d5-83d2-44a721b7542f', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:05:14.060531 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:14.061156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:14.067185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.067699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.068135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.068826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.069278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.069697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.292950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:14.300764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-498c1f34-fb53-4494-8082-5911573785ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.244824 Oct 17 07:05:14.301338 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 157/310] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:14 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:14.394789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:05:14.395234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:05:14.395720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:05:14.396130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:05:14.396542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:05:14.405895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.406374 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.406810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.407577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.408032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.408456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.424998 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Getting quotas for project db8098f6f78c49fa843d34d69b002daa. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:14.429021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Getting quotas for user c09a31533d7847fea61682ff032f838b and project db8098f6f78c49fa843d34d69b002daa. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:14.439856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:05:14.442029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4cb9e3e4-b9a0-4e27-bd7a-1a52f49f13f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:05:14.488012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ed235a7e-db05-4269-b841-d36686b5ce47 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573616 Oct 17 07:05:14.488753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 154/311] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:05:14.500020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4e4713ed-7986-4da8-b8ef-e9a5b279f4b8 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:14.500631 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4e4713ed-7986-4da8-b8ef-e9a5b279f4b8 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:14.554585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4e4713ed-7986-4da8-b8ef-e9a5b279f4b8 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:14.562235 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4e4713ed-7986-4da8-b8ef-e9a5b279f4b8 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1257 microversion: 2.1 time: 0.066118 Oct 17 07:05:14.562816 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 158/312] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:14 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:14.675646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:14.676431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:14.683676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.684102 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.684533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.685251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.685707 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.686129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.716786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.717274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.717710 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.718145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid c3994e56-480f-4d32-bd42-0e14c2de3327 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:14.761797 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:14.769653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9c548059-a0d5-4612-b69d-0ab279297447 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1304 microversion: 2.1 time: 0.098073 Oct 17 07:05:14.770346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 155/313] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:14 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:14.831577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:14.832882 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:14.840273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.840946 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.841387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.842114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.842755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.843182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.862071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:14.863419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:14.870400 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.870970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.871500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:14.872265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:14.872816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:14.873302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.032303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:15.040377 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-908b1590-b65c-4563-895e-dafdb68a576f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.212643 Oct 17 07:05:15.040955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 159/314] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:14 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:15.048817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:15.057075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6bf40cd2-ac1d-4057-bdaf-62c31fe67bed tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1469 microversion: 2.1 time: 0.199668 Oct 17 07:05:15.057630 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 156/315] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:14 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:15.324150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:15.325044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:15.330908 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.331419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.331845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.332523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.332972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.333391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.459973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:15.467542 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7a347bf8-b2dd-4028-a58d-d22c7a4f9365 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.147744 Oct 17 07:05:15.468135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 160/316] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:15 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:15.585599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:15.586205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:15.592252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.592724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.593151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.593823 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.594293 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.594707 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.659202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:15.667314 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0d690044-7c33-4722-933d-7d880c03f8a6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1261 microversion: 2.1 time: 0.085539 Oct 17 07:05:15.667807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 157/317] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:15 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:15.793671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:15.794281 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:15.800141 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.800620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.801221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.801914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.802374 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.802797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.833157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:15.833753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:15.834047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:15.834490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid c3994e56-480f-4d32-bd42-0e14c2de3327 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:15.876991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:15.885748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-86c06e07-57d8-4f7e-b75e-760fccc1ef2b tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1304 microversion: 2.1 time: 0.096391 Oct 17 07:05:15.886455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 161/318] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:15 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:16.063777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:16.064395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:16.070860 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.071863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.072309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.072997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.073454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.073879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.080997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:16.081602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:16.088035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.088520 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.088951 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.089634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.090082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.090500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.095791 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:16.272237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:16.276268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:16.280686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-56797c60-3e75-4bf0-bd1e-5e7b62493148 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.220726 Oct 17 07:05:16.281328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 158/319] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:16 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:16.283942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a7782bcb-2aa6-4592-ac5b-4da45ced62d4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1469 microversion: 2.1 time: 0.206768 Oct 17 07:05:16.284495 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 162/320] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:16 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:16.490316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:16.490849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:16.496855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.497336 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.497776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.498456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.498907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.499359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.624355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:16.631953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9279e27f-650b-4857-b7ed-b248bad427aa tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1510 microversion: 2.1 time: 0.145620 Oct 17 07:05:16.632527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 159/321] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:16 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:16.689748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:16.690351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:16.696834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.697333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.697762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.698448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.698918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.699375 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.761753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:16.769403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-781f83e6-e312-4d29-8cc3-8be4b8efe6d4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1261 microversion: 2.1 time: 0.083531 Oct 17 07:05:16.769955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 163/322] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:16 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:16.908597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:16.909216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:16.915805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.916292 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.916727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.917418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.917875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.918298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.950235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:16.950718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:16.951150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:16.951617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid c3994e56-480f-4d32-bd42-0e14c2de3327 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:16.998376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:17.005976 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-adc92e59-3aa4-404e-affa-2b2aff45045c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1304 microversion: 2.1 time: 0.101423 Oct 17 07:05:17.006526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 160/323] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:16 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:17.304490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:17.305136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:17.305788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:17.306405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:17.311729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.312240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.312670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.312770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.313217 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.313353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.313652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.313846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.314266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.314365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.314764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.315181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.724187 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:17.727430 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:17.732922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9e30ad47-4baf-4c44-ba76-7e308f712cd0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.432454 Oct 17 07:05:17.733484 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 164/324] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:17 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:17.736066 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8a4f6698-c98b-4975-90ff-5d7f33d6db6f tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1469 microversion: 2.1 time: 0.434300 Oct 17 07:05:17.736752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 161/325] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:17 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:17.737814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:17.738405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:17.750385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.751417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.751978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.752679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.753129 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.753579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.793473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:17.794084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:17.800471 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.800950 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.801376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.802062 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:17.802575 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:17.802994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:17.935095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:17.942713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-21e95b1d-4331-4d02-b3d8-709b58b2999c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1253 microversion: 2.1 time: 0.154029 Oct 17 07:05:17.955551 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 162/326] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:17 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1253 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:18.028399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:18.029144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:18.035126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.035713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.036215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.036975 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.037521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.037952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:18.038072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.047350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5cac07bb-6777-420c-b42f-f024a4144cbd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1516 microversion: 2.1 time: 0.312821 Oct 17 07:05:18.051242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 165/327] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:17 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:18.073881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.073881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.074207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.074658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid c3994e56-480f-4d32-bd42-0e14c2de3327 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:18.122757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:18.130579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6d838407-ea71-468f-8036-5d25ad1fc276 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 200 len: 1304 microversion: 2.1 time: 0.106025 Oct 17 07:05:18.143427 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 163/328] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:18 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:18.391778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-a5c17cf7-95d0-4fa1-9fea-9b10e4ba6be2 req-f4f557c3-64a9-4b47-9705-09e136777ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e236fd-c560-4cbb-9cd1-739186d03772", "name": "network-vif-deleted", "tag": "299658d0-3138-44dc-bc44-8503301025a9"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:18.402389 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a5c17cf7-95d0-4fa1-9fea-9b10e4ba6be2 req-f4f557c3-64a9-4b47-9705-09e136777ed5 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.402868 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a5c17cf7-95d0-4fa1-9fea-9b10e4ba6be2 req-f4f557c3-64a9-4b47-9705-09e136777ed5 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.403331 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a5c17cf7-95d0-4fa1-9fea-9b10e4ba6be2 req-f4f557c3-64a9-4b47-9705-09e136777ed5 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.415891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-a5c17cf7-95d0-4fa1-9fea-9b10e4ba6be2 req-f4f557c3-64a9-4b47-9705-09e136777ed5 service nova] Creating event network-vif-deleted:299658d0-3138-44dc-bc44-8503301025a9 for instance 22e236fd-c560-4cbb-9cd1-739186d03772 on hv-cinder-84506 Oct 17 07:05:18.421006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-a5c17cf7-95d0-4fa1-9fea-9b10e4ba6be2 req-f4f557c3-64a9-4b47-9705-09e136777ed5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034391 Oct 17 07:05:18.421609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 166/329] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:18.756569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:18.757113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:18.759713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:18.760449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:18.765099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.765582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.766040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.766732 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.766934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.767181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.767310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.767626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.767721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.768387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.768836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.769248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.855563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:18.863498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-da9a3281-5dcf-4a86-b18c-46e9a9ea2023 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1299 microversion: 2.1 time: 0.108544 Oct 17 07:05:18.864064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 167/330] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:18 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:18.918549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:18.926702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-173cd391-a690-441e-b45b-1609dc580649 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.174336 Oct 17 07:05:18.927293 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 164/331] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:18 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:18.965843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:18.966446 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:18.972554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.973034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.973462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:18.974142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:18.974590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:18.975006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.043132 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:19.052522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-64a529bc-3dce-460d-928a-b2ab56e31ee0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1309 microversion: 2.1 time: 0.090539 Oct 17 07:05:19.053378 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 168/332] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:18 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:19.153769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:19.154396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: c3994e56-480f-4d32-bd42-0e14c2de3327] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:19.161919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.162414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.162850 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.163635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.164093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.164525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.178203 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] HTTP exception thrown: Instance c3994e56-480f-4d32-bd42-0e14c2de3327 could not be found. Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Request method failure captured: Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 HTTP/1.1 Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP6OteQ4nhbCQv3albFeC3Bbxb9HQfz-nlOm7-anJl-gDxnt22L5QVZkCyBEnK7KCrBq2XfDQcauvlhr77ke7h64222yUWY-kPw4QqSUkcSIRUsLSaMeIvsEPNMrtyeN6aHE3sHGqmr66wgw4ktkVRwjasX9NKgyDOapoe6TF-HpwTI Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 58fdf05cfb044a2aa98bc12a38fb76cd Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesActionsTest-1612480862 Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:05:19.179891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/58fdf05cfb044a2aa98bc12a38fb76cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/58fdf05cfb044a2aa98bc12a38fb76cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/58fdf05cfb044a2aa98bc12a38fb76cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_58fdf05cfb044a2aa98bc12a38fb76cd"}]}] Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesActionsTest-1612480862 Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 58fdf05cfb044a2aa98bc12a38fb76cd Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesActionsTest-1612480862 Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesActionsTest-1612480862-project Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 2e07169459e44b079cbcc5157874c89a Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesActionsTest-1612480862-project Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance c3994e56-480f-4d32-bd42-0e14c2de3327 could not be found. Oct 17 07:05:19.181863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'c3994e56-480f-4d32-bd42-0e14c2de3327'} Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3994e56-480f-4d32-bd42-0e14c2de3327 could not be found. Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:05:19.182666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3994e56-480f-4d32-bd42-0e14c2de3327 could not be found. Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3994e56-480f-4d32-bd42-0e14c2de3327 could not be found. Oct 17 07:05:19.183862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:05:19.184870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Returning 404 to user: Instance c3994e56-480f-4d32-bd42-0e14c2de3327 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:05:19.184870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2db1fc8c-5e07-4dab-9393-77b6d7c9a6b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327" status: 404 len: 111 microversion: 2.1 time: 0.032438 Oct 17 07:05:19.184870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 165/333] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:19 2022] GET /compute/v2.1/servers/c3994e56-480f-4d32-bd42-0e14c2de3327 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:05:19.280758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-97496586", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "networks": [{"uuid": "e9aa654f-09bd-4827-bc2e-9633196f1792"}]}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:19.289215 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:19.337788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] validate_networks() for [('e9aa654f-09bd-4827-bc2e-9633196f1792', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:05:19.429362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-839d5b72-1869-4f0f-8886-7a0252b17cdd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'create', calling method: .version_select at 0x7f4acdf9c0d0>, body: {"keypair": {"name": "tempest-keypair-549981407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd0mBWCnA7bFSvtQW9DwoObCVNQNskRQxty0KcpviXzyyeA4/xmzAe3Dkso79DE9RAbLbfqmgzgDczYwGIjVjMGzcrMLdpAAldicPL9jmVFLLw5RxyWOOXMtbaK87vMDw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:19.444669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-839d5b72-1869-4f0f-8886-7a0252b17cdd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:19.448482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-839d5b72-1869-4f0f-8886-7a0252b17cdd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for user c987a5a52fc641f78054ac0218edcd13 and project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:19.470819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-839d5b72-1869-4f0f-8886-7a0252b17cdd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045253 Oct 17 07:05:19.471435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 166/334] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:05:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:19.793941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:05:19.793941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:05:19.793941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:05:19.793941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:05:19.793941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:05:19.802653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.803147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.803606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.804376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.806475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.806924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.830369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Getting quotas for project 58fdf05cfb044a2aa98bc12a38fb76cd. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:19.834343 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Getting quotas for user 2e07169459e44b079cbcc5157874c89a and project 58fdf05cfb044a2aa98bc12a38fb76cd. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:19.846227 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:05:19.848598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:05:19.887139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:19.887756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:19.895328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-156e4ad3-12c4-44e8-a01a-af2e12f15895 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618388 Oct 17 07:05:19.902423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 169/335] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:05:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:05:19.904615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.905333 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.905969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.906927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.907615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.908240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.908438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-927b6db8-06bf-450f-8d5a-76c3c4c97f07 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:19.909540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-927b6db8-06bf-450f-8d5a-76c3c4c97f07 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:19.986499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:19.987073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:19.987706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:19.988310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:19.990084 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-927b6db8-06bf-450f-8d5a-76c3c4c97f07 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:20.000212 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-927b6db8-06bf-450f-8d5a-76c3c4c97f07 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1212 microversion: 2.1 time: 0.096052 Oct 17 07:05:20.001393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 170/336] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:19 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:20.006274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:20.006913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:20.015260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:20.015769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:20.016209 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:20.017039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:20.017506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:20.017936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:20.051966 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:20.060589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ad8a1eb0-4402-41c1-983a-ad8cc96a0eb4 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.178281 Oct 17 07:05:20.061155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 167/337] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:19 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:20.084573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:20.085513 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:20.094939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:20.097475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:20.105010 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:20.105653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:20.106560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:20.108129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:20.108791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:20.271392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:20.276659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:20.284534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-515ccc01-9cd4-4e08-907e-cb2543110a21 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1309 microversion: 2.1 time: 0.204670 Oct 17 07:05:20.286746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 168/338] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:20 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1309 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:20.304497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:20.306811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c461c7a4-8c7f-47cb-9f19-aa0ca1f6935a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: .version_select at 0x7f4acd2a7ca0>, body: {"keypair": {"name": "tempest-keypair-43968653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbYHbD1ZfoHgQQKpt49MpmvWstE5kqk/+XmK7YDmysbdg+ur1Xl9gjw1INC7Fafmfxv2LahJH6dt1mxXHIG6xpnAaM9B3QJAvJAw8CbYNdKQVSG7DDs2YVMPs56yTnirw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:20.318172 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-edcc8e54-4faa-4493-bb86-a95647477b6d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.315633 Oct 17 07:05:20.320001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 171/339] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:20 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:20.329029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c461c7a4-8c7f-47cb-9f19-aa0ca1f6935a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:20.333079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c461c7a4-8c7f-47cb-9f19-aa0ca1f6935a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:20.359931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c461c7a4-8c7f-47cb-9f19-aa0ca1f6935a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.059788 Oct 17 07:05:20.360825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 169/340] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:05:20 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:21.026760 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:21.027557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:21.034264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.034871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.035480 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.036385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.037006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.037437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.085197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:21.086607 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:21.099376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.100094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.101739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.103031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.115739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.116154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.148974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.149750 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.150334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.150936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:21.180594 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:21.189596 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cdc15e05-1de7-4f39-b1cc-761d04d034f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.167241 Oct 17 07:05:21.190441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 172/341] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:21 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:21.287096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:21.301048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7eac43b2-9f8d-4098-adaf-1ea33f2aa44c tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.214910 Oct 17 07:05:21.302216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 170/342] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:21 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:21.325225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:21.326093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:21.332000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.332665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.333268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.333979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.334423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.334847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.345817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:21.346819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:21.355391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.358353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.362345 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.363384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:21.363839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:21.364612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:21.471103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:21.480705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-26103166-91b3-46c4-bec0-8aca14f5b536 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.163216 Oct 17 07:05:21.492243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 173/343] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:21 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:21.648287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:21.660170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-88433f62-38fd-4ecd-9193-0ba1276e67fa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.318079 Oct 17 07:05:21.663361 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 171/344] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:21 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:21.754577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2011379499", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce8a5513-da89-4319-af4d-c07814f849c0"}], "security_groups": [{"name": "tempest-securitygroup--1056517339"}], "key_name": "tempest-keypair-549981407", "user_data": "}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:21.958718 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] validate_networks() for [('ce8a5513-da89-4319-af4d-c07814f849c0', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:05:22.214720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:22.217686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:22.237997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.238604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.239130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:22.240252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.241080 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.241695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:22.409955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:22.420914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-af028d5e-aa84-4bb9-b22a-c2896d81504a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.211208 Oct 17 07:05:22.437594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 172/345] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:22 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:22.450798 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:22.451780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:22.458026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.458799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.459505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:22.460401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.461041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.472099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:22.526065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.526637 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.527073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:22.527675 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:22.864371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:22.873425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4f75f5e5-9918-4205-a892-5814cc6a0387 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.434100 Oct 17 07:05:22.874219 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 173/346] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:22 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:22.888338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:22.891937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:22.898446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.898963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.903265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:22.903265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:22.903265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:22.903265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.234867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:23.239763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:05:23.241756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:05:23.242664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:05:23.243819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:05:23.244412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:05:23.245142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eeebe7cb-6e50-4429-9d62-20be2563733d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.368822 Oct 17 07:05:23.245985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 174/347] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:22 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:23.251378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:23.252230 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:23.258372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.260042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.260720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.261781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.262459 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.263190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.275622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.276120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.276560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.281902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.282519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.283167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.321110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:23.327093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Getting quotas for user c987a5a52fc641f78054ac0218edcd13 and project 0cb1aa55658342fcaf2f493f51e9faeb. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:23.345136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:05:23.347975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:05:23.433108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ac453857-fae3-4cd9-8181-bd2b5fd71495 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.681410 Oct 17 07:05:23.444916 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 174/348] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:05:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:05:23.482962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:23.484294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:23.502012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.509449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.510017 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.510850 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.511435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.511956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.565319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:23.580126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e501b7fe-b370-4862-858a-c85a1b5837be tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.332842 Oct 17 07:05:23.580727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:23 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:23.608454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-76e610c2-f7c3-4817-add3-81aaba021ceb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:23.609283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-76e610c2-f7c3-4817-add3-81aaba021ceb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:23.641643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:23.649450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4693d845-dd96-4ae6-bf49-ae50297d09b0 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.202368 Oct 17 07:05:23.653295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 175/350] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:23 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:23.693865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-76e610c2-f7c3-4817-add3-81aaba021ceb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:23.703372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-76e610c2-f7c3-4817-add3-81aaba021ceb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1245 microversion: 2.1 time: 0.110407 Oct 17 07:05:23.708688 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 176/351] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:23 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:23.754320 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1533004480", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b"}], "security_groups": [{"name": "tempest-securitygroup--1774601223"}], "key_name": "tempest-keypair-43968653", "user_data": "}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:23.894045 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] validate_networks() for [('27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:05:23.899117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:23.900326 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:23.907734 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.908651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.909368 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.915466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.916780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.919445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.988434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:23.989024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:23.989690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:23.990369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:24.049943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:24.073872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e7323f31-9a4f-47b9-88bc-37d9d41e2e04 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.180002 Oct 17 07:05:24.075921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 177/352] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:23 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:24.268449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:24.269890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:24.277431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.278155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.278752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.279469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.280067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.280490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.415781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:24.423759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:05:24.424284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:05:24.424813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:05:24.425305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:05:24.425997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:05:24.435393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.435870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.436293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.437004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.437449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.437918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.457589 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:24.460021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:24.461730 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:24.470898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8d79902b-d505-45f0-b525-c748d73611c0 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.205866 Oct 17 07:05:24.472527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 178/353] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:24 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:24.487412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:05:24.489870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:05:24.544739 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-867b79d1-5776-4c71-971a-843279e8304b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.794563 Oct 17 07:05:24.545301 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 176/354] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:05:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:05:24.557122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6063ba25-19b5-4c47-abaf-522ad60b68fb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:24.557820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6063ba25-19b5-4c47-abaf-522ad60b68fb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:24.607007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:24.607756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:24.614529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.615115 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.615658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.616454 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.617023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.623686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.652811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6063ba25-19b5-4c47-abaf-522ad60b68fb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:24.661138 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6063ba25-19b5-4c47-abaf-522ad60b68fb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1240 microversion: 2.1 time: 0.108364 Oct 17 07:05:24.665537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 179/355] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:24 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1240 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:24.680753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:24.681380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:24.689489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.690526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.691512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.692851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.693648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.694291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.779364 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:24.788581 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d2c5721f-da64-46b7-b773-f4029c4ee1ae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.185381 Oct 17 07:05:24.805023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 177/356] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:24 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:24.811847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:24.812579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:24.822378 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.823280 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.823968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.825485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:24.826185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:24.826822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:24.845624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:24.855479 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-324ab9f6-2e42-4379-ab19-c8bda63723b3 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.179237 Oct 17 07:05:24.856605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 180/357] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:24 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:24.904756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:24.913185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a5322393-46af-4d5d-b713-d32a6a91a054 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1249 microversion: 2.1 time: 0.106924 Oct 17 07:05:24.914037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 178/358] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:24 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:25.102008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:25.102581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:25.108594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.109077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.109514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.110201 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.110657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.111078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.142099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.142583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.143022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.143497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:25.190626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:25.200510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06abe1d1-e512-4c1a-aea3-265b730a863b tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.102087 Oct 17 07:05:25.205652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 181/359] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:25 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:25.495052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:25.495835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:25.502302 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.502864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.503336 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.504298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.504763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.505159 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.641282 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:25.649004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-56fc2b3d-ca2c-422f-a563-ac4ccf021c18 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.158504 Oct 17 07:05:25.649638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 179/360] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:25 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:25.689921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:25.690532 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:25.697602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.698084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.698518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.699234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.700129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.700556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.764375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:25.773598 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ce675c48-70d5-4436-85e4-8d55e3126897 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1244 microversion: 2.1 time: 0.087461 Oct 17 07:05:25.774178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 182/361] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:25 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:25.816532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:25.817528 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:25.824094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.824711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.825612 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.826427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.827094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.827635 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.878323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:25.879360 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:25.886760 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.887429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.887951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.888727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:25.889262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:25.889817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:25.969590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:25.978393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-25c395f0-fed7-4695-a034-a5e5ae6ec10c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.103524 Oct 17 07:05:25.990940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 183/362] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:25 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:25.999814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:26.000840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:26.001463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:26.008992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.009854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.010000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-16ae29cb-8d5a-4912-924f-76a9c31cdcf7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.197269 Oct 17 07:05:26.010299 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.015499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.015605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 180/363] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:25 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:26.015704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.015704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.075190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:26.083139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d7ca527e-acd4-414b-8402-54b9798608d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1249 microversion: 2.1 time: 0.086971 Oct 17 07:05:26.083686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 184/364] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:25 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:26.223881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:26.224538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:26.231189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.231712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.232150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.232861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.233316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.233741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.267292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.267974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.268440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.268882 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:26.312862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:26.320937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-49e7aad0-89b4-4fd8-a2d5-971e8735bce2 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.100882 Oct 17 07:05:26.321611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 181/365] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:26 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:26.671991 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:26.672802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:26.679165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.679792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.680329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.681281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.681851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.682380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.796306 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:26.797565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:26.806859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.807558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.808158 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.809030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:26.809761 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:26.810352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:26.815164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:26.819020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:26.832334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-22ffbfdc-4f30-40f7-a6b7-7964adf618f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.164022 Oct 17 07:05:26.848975 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 185/366] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:26 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:26.887517 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:26.896508 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7ce35c15-9ac3-4542-ba8d-83e6a647e628 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1244 microversion: 2.1 time: 0.104121 Oct 17 07:05:26.906893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 182/367] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:26 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:27.006012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:27.006542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:27.013544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.014037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.014477 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.015176 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.015654 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.016076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.036660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:27.037273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:27.043059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.043572 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.044002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.044679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.045131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.045550 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.078592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:27.087221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a2a67992-022f-4f2d-9e82-6a3631de9d18 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.084883 Oct 17 07:05:27.088510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 186/368] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:27 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:27.108599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:27.114940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:27.115387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.115881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.116307 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.117004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.117447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.117887 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.122200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:27.198389 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:27.206237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-92e4aad6-9d44-4d5c-a6c4-c6b696eb9adc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1249 microversion: 2.1 time: 0.101578 Oct 17 07:05:27.219266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 187/369] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:27 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:27.229044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:27.238256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9e95b432-af14-47f5-81fd-dd17c34760ba tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.205354 Oct 17 07:05:27.239105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 183/370] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:27 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:27.344237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:27.344762 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:27.350733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.351258 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.351674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.352471 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.352924 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.353343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.384465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.384945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.385376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.385819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:27.426836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:27.435921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-52858c4a-90ae-497d-a55a-24b7900b20f1 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.096043 Oct 17 07:05:27.436879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 188/371] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:27 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:27.856371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:27.856971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:27.864253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.864741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.865179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.865884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.866336 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.866758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.925229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:27.925929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:27.934997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.935596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.936031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:27.936738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:27.937191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:27.937628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.018894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:28.028252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b8e522d4-56d6-4f96-905a-18b75fe8ca66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1244 microversion: 2.1 time: 0.109674 Oct 17 07:05:28.028838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 189/372] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:27 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:28.035083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:28.043483 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6a11a835-9649-458b-83d2-c5540e0a5cfd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.191417 Oct 17 07:05:28.044040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 184/373] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:27 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:28.112528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:28.113059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:28.119942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.120428 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.120858 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.121559 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.122013 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.122437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.187427 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:28.195071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-57613711-8222-4392-91cd-8fcff0a1fe74 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.086518 Oct 17 07:05:28.195673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 190/374] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:28 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:28.230673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:28.231313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:28.237361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.237841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.238280 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.241978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.242452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.242945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.263891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:28.265068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:28.272443 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.272933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.273366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.274064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.275355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.275790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.316856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:28.325984 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3ab40158-3e1e-4e25-b969-fde0ed922375 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1249 microversion: 2.1 time: 0.100218 Oct 17 07:05:28.326976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 185/375] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:28 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:28.413501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:28.422982 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6b262c39-d630-4646-b2c6-f9194212af08 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.164916 Oct 17 07:05:28.423590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 191/376] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:28 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:28.459676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:28.460277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:28.466952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.467755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.468343 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.469188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.471914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.472474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.505734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:28.506209 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:28.506637 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:28.507076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:28.548684 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:28.556598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e4f4660d-aec5-42f9-b62c-0552684ad5c7 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.100711 Oct 17 07:05:28.557162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 186/377] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:28 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:29.051084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:29.051714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:29.067519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.067519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.067519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.067519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.067952 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.067952 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.068104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:29.068104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:29.073121 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.073553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.073982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.074673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.075552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.075976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.141992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:29.155264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d0db73d5-8af9-4954-a25a-e46cce2ebc07 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1244 microversion: 2.1 time: 0.103468 Oct 17 07:05:29.155264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 192/378] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:29 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:29.218581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:29.219800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:29.227519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.228009 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.228590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.229847 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.230597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.231592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.244311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:29.255047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e3f4d2e7-8034-4aac-bf1f-d61f72fda094 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.192594 Oct 17 07:05:29.255856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 187/379] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:29 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:29.302044 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:29.310723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c8c4f3e1-f69f-4f38-94e7-ce1a643bf342 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.095948 Oct 17 07:05:29.319305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 193/380] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:29 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:29.349983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:29.350603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:29.357271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.357902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.358391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.359082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.359556 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.359974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.427492 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:29.443965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-90596638-db13-4357-a6fe-560ea12c3dac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1249 microversion: 2.1 time: 0.097823 Oct 17 07:05:29.451096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 188/381] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:29 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:29.453295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:29.453295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:29.454028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.454572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.455092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.455868 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.456316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.456732 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.580383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:29.581004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:29.587611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.588166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.588664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.589359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.589809 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.590223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.595921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:29.605604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e7b4819a-cc94-46aa-9639-b1c4f2ab4be5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.162739 Oct 17 07:05:29.619712 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 194/382] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:29 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:29.621982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:29.622535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:29.623076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:29.623600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:29.665203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:29.672913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-78f4d295-f13e-4ea6-8945-1e0347764edc tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.096519 Oct 17 07:05:29.673475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 189/383] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:29 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:30.172799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:30.173417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:30.181211 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.181704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.182136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.182931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.183837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.183837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.246667 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:30.254522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d9111cc2-f257-425a-9953-684af61b8184 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1244 microversion: 2.1 time: 0.085621 Oct 17 07:05:30.255087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 195/384] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:30 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:30.278214 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:30.278822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:30.287678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.288167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.289304 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.290767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.291368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.291911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.333876 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:30.334637 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:30.340899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.341444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.341872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.342570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.343018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.343471 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.416833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:30.424397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-990d2095-a540-44b9-a50c-d0bb4f487ce7 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.094393 Oct 17 07:05:30.424960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 196/385] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:30 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:30.446082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:30.453912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-15da382d-7a03-4f55-9c3c-2c2193d068f3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.180209 Oct 17 07:05:30.454461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 190/386] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:30 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:30.466826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:30.467480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:30.473541 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.474053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.474495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.475176 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.475775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.476199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.536358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:30.544585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-413ce906-aa7a-4fbd-9fb6-f194120ebf9f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1249 microversion: 2.1 time: 0.081619 Oct 17 07:05:30.545141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 197/387] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:30 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:30.628826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:30.629464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:30.635376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.635857 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.636286 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.636963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.637413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.637833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.696275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:30.696902 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:30.703017 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.703528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.703965 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.704660 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.705116 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.705538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.737671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:30.738524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:30.739351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:30.740215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lazy-loading 'fault' on Instance uuid 22e236fd-c560-4cbb-9cd1-739186d03772 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:30.773589 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:30.782249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-14310c94-c392-41f5-b86a-0e8d8c47570e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.157288 Oct 17 07:05:30.795569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 191/388] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:30 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:30.795813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2a6b0ec599444385bde13a429a7ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91958c61267b494aabe3e63a13d6f452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:30.798718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bc8e9b10-91f8-4d88-a65c-f8a62e675609 tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 200 len: 1304 microversion: 2.1 time: 0.106352 Oct 17 07:05:30.799397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:30 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:31.279797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:31.281459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:31.291691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:31.293582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.294515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.295880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.296820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.297437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.298016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.405135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:31.417261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-126ccb42-cc86-455e-a9a5-a7f6f5222bc4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1244 microversion: 2.1 time: 0.143363 Oct 17 07:05:31.426247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 192/390] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:31 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1244 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:31.449578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:31.450446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:31.456634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.457326 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.457996 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.458714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.459156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.459602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.478549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:31.479388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:31.485743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.486368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.487240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.487813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.488410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.488957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.532499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:31.540741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-df9f1f67-0d8d-4ba6-9503-7fae80de51b8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1208 microversion: 2.1 time: 0.094934 Oct 17 07:05:31.546564 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 199/391] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:31 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1208 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:31.569544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:31.570251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:31.578059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.578616 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.579001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.579779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.580400 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.580822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.670803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:31.679013 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b68254fb-e59d-4bd1-b612-93e0d06d2b03 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1241 microversion: 2.1 time: 0.113764 Oct 17 07:05:31.679787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 200/392] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:31 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:31.732861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:31.740944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2f91f03e-eb85-457b-aa6c-b05f695b2de5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.267403 Oct 17 07:05:31.741724 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 193/393] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:31 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:31.808195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:31.808809 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:31.816455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.817137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.817735 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.818586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.819190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.819781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.821785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:31.822506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] [instance: 22e236fd-c560-4cbb-9cd1-739186d03772] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:31.829234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.829576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.830142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.830898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:31.831445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:31.832135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:31.851963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] HTTP exception thrown: Instance 22e236fd-c560-4cbb-9cd1-739186d03772 could not be found. Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Request method failure captured: Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 HTTP/1.1 Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP6Qcgw5A-4TYoWMp5fNT4r1AWfQr7NbqlerqwnZV7UT_n9-R0HWwCZudgIVKEwR_kLRMv-P-0gR1PHO1e_-5Y5kNlWrnFiYoBprX5ozXtJHihRWBqUSD6DZSgXUbHM95GiDytoKvWCJDYw9xUKxwcKUzSh6gsnwwVFYO-lKrWmu3wo Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 91958c61267b494aabe3e63a13d6f452 Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesNegativeTest-411189036 Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:05:31.853877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/91958c61267b494aabe3e63a13d6f452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/91958c61267b494aabe3e63a13d6f452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/91958c61267b494aabe3e63a13d6f452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_91958c61267b494aabe3e63a13d6f452"}]}] Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesNegativeTest-411189036 Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 91958c61267b494aabe3e63a13d6f452 Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesNegativeTest-411189036 Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesNegativeTest-411189036-project Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 7a2a6b0ec599444385bde13a429a7ecb Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesNegativeTest-411189036-project Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 22e236fd-c560-4cbb-9cd1-739186d03772 could not be found. Oct 17 07:05:31.855470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '22e236fd-c560-4cbb-9cd1-739186d03772'} Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e236fd-c560-4cbb-9cd1-739186d03772 could not be found. Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:05:31.856362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e236fd-c560-4cbb-9cd1-739186d03772 could not be found. Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e236fd-c560-4cbb-9cd1-739186d03772 could not be found. Oct 17 07:05:31.857805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:31.859007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] Returning 404 to user: Instance 22e236fd-c560-4cbb-9cd1-739186d03772 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:05:31.859007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-66887bcd-5e8c-48e7-b38f-1d4a0d2a76ec tempest-VolumesNegativeTest-411189036 tempest-VolumesNegativeTest-411189036-project] 10.222.0.36 "GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772" status: 404 len: 111 microversion: 2.1 time: 0.039825 Oct 17 07:05:31.859007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 194/394] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:31 2022] GET /compute/v2.1/servers/22e236fd-c560-4cbb-9cd1-739186d03772 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:05:32.035774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:32.045309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2d97f5c6-fefd-4127-bedb-94308a978e84 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.241264 Oct 17 07:05:32.046380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 201/395] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:31 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:32.185237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-5fe8b739-6b65-4b3d-a74e-1801b406cc27 req-70f9069c-b0e7-4431-920d-67f8fd6bb273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:32.209008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-5fe8b739-6b65-4b3d-a74e-1801b406cc27 req-70f9069c-b0e7-4431-920d-67f8fd6bb273 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.209566 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-5fe8b739-6b65-4b3d-a74e-1801b406cc27 req-70f9069c-b0e7-4431-920d-67f8fd6bb273 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.210008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-5fe8b739-6b65-4b3d-a74e-1801b406cc27 req-70f9069c-b0e7-4431-920d-67f8fd6bb273 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.222014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-5fe8b739-6b65-4b3d-a74e-1801b406cc27 req-70f9069c-b0e7-4431-920d-67f8fd6bb273 service nova] Creating event network-changed:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:05:32.232018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-5fe8b739-6b65-4b3d-a74e-1801b406cc27 req-70f9069c-b0e7-4431-920d-67f8fd6bb273 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046918 Oct 17 07:05:32.232711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 195/396] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:32.439730 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:32.440349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:32.446390 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.447233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.447832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.448800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.449250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.449737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.519145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:32.528918 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dfa2ca4e-f3b5-476d-8f47-76a1b838fe60 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1236 microversion: 2.1 time: 0.092955 Oct 17 07:05:32.531767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 202/397] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:32 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:32.567260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:32.572194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:32.580579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.581475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.582291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.583408 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.587549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.588043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.669278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:32.676991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-62611ed4-c5d3-4941-9f7d-0ce2c340da22 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1264 microversion: 2.1 time: 0.114555 Oct 17 07:05:32.677463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 196/398] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:32 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1264 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:32.702020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:32.702627 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:32.708560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.709038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.709473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.710155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.710608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.711029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.715478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:32.764631 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:32.765318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:32.771480 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.772651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.773107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.773833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:32.774334 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:32.774790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:32.775282 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:32.784239 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-034b5405-ccec-4f58-a800-dceae7d9abd8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1241 microversion: 2.1 time: 0.086314 Oct 17 07:05:32.785311 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 203/399] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:32 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:32.964553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:32.975501 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ca248e90-2bfb-4e81-90f0-662c92fa15ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.214757 Oct 17 07:05:32.980703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 197/400] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:32 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:33.069926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:33.072038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:33.082854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.083506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.084895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.086688 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.087285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.088059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.234664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:33.243681 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bb9fe45f-fae9-4d7b-9249-04cbb2fa1504 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.177276 Oct 17 07:05:33.244400 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 204/401] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:33 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:33.552541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:33.553157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:33.559557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.560039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.560472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.561160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.561614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.562034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.628220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:33.636830 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-596c25b2-5ed8-4bf9-a3ce-a570e9b15bed tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1236 microversion: 2.1 time: 0.088072 Oct 17 07:05:33.637395 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 198/402] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:33 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:33.702398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:33.702398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:33.704289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:33.709988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.710546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.711112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.711858 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.712301 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.712720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.782008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:33.790372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d34f54dc-f152-435b-858d-82bd83711357 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1282 microversion: 2.1 time: 0.093350 Oct 17 07:05:33.790927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 205/403] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:33 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:33.806510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:33.807147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:33.813217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.813773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.814205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.814896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:33.815376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:33.815800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:33.834870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:33.879806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:33.889482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a6fd9b02-1c5b-49aa-9f48-aefce8b39d52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1297 microversion: 2.1 time: 0.087461 Oct 17 07:05:33.890122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 199/404] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:33 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:34.002934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:34.003560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:34.009468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.009944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.010369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.011057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.011527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.011948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.269599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:34.270247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:34.279567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.279567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.279567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.279790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.280226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.280998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.285353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:34.296402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cd4e4089-d06f-4ebe-939f-e525f7a055bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.295871 Oct 17 07:05:34.297264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 206/405] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:33 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:34.445695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=6 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:34.468655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=26 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:34.554852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:34.570738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2e9b013f-b7c0-4c5b-9766-dcc5db9e6dc6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.306751 Oct 17 07:05:34.571505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 200/406] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:34 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:34.661117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:34.661740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:34.665368 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=18 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:34.669551 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.670046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.670481 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.671171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.671662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.672081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.742804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:34.750586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fbd00513-8443-45ef-8009-d57914d1f677 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1236 microversion: 2.1 time: 0.093824 Oct 17 07:05:34.751347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 207/407] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:34 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:34.813866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:34.814518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:34.820676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.821192 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.821790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.822473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.823079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.823522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.912969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:34.914413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:34.920442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.920935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.921380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:34.922060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:34.922693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:34.923119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.034816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:35.052088 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cf1c944b-49ed-4412-a94d-3eb2a04216cd tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1297 microversion: 2.1 time: 0.143093 Oct 17 07:05:35.067569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 208/408] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:34 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:35.127388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:35.137244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b947cb7a-545e-4f82-86e3-dec26bc38f3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.327314 Oct 17 07:05:35.137837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 201/409] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:34 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:35.319701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:35.320590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:35.328509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:35.331101 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:35.332048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.333014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:35.333725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:35.334374 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.596607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:35.597616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:35.602396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:35.606160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:35.606935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:35.607651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.609053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:35.609710 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:35.610462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.610696 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8230d483-79d1-4fbc-bde8-534258a6dde9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.295150 Oct 17 07:05:35.611502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 209/410] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:35 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:35.756973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:35.766228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cb73a2f3-0bac-4703-a623-f360619b65d2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.174491 Oct 17 07:05:35.766693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 202/411] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:35 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:35.776700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:35.777380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:35.784656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:35.784656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:35.784656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.785381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:35.785832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:35.786255 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:35.853566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:35.884236 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f033c2e1-4cfd-4c99-96fb-f920602ca871 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1292 microversion: 2.1 time: 0.110876 Oct 17 07:05:35.885980 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 210/412] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:35 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:36.081267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:36.082389 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:36.090154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.090813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.091433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.092744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.093503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.094090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.169947 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:36.170989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:36.179050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.179975 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.181207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.182501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.183302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.183898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.252551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:36.262632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0c00f872-7f97-4d75-aac5-e505c8977b62 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1303 microversion: 2.1 time: 0.185930 Oct 17 07:05:36.266535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 203/413] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:36 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:36.324544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-7989c53e-807b-464b-ae1f-60efe8abc8cd req-999cf24f-80c1-47d8-a23d-07c1bb5db37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78fc0d3-677f-443b-a0f5-1650adce3478", "tag": "739e5f9f-69c4-4e14-809a-e5c09082e758"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:36.342333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7989c53e-807b-464b-ae1f-60efe8abc8cd req-999cf24f-80c1-47d8-a23d-07c1bb5db37d service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.343047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7989c53e-807b-464b-ae1f-60efe8abc8cd req-999cf24f-80c1-47d8-a23d-07c1bb5db37d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.343749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7989c53e-807b-464b-ae1f-60efe8abc8cd req-999cf24f-80c1-47d8-a23d-07c1bb5db37d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.359773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-7989c53e-807b-464b-ae1f-60efe8abc8cd req-999cf24f-80c1-47d8-a23d-07c1bb5db37d service nova] Creating event network-changed:739e5f9f-69c4-4e14-809a-e5c09082e758 for instance b78fc0d3-677f-443b-a0f5-1650adce3478 on hv-cinder-84506 Oct 17 07:05:36.365918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-7989c53e-807b-464b-ae1f-60efe8abc8cd req-999cf24f-80c1-47d8-a23d-07c1bb5db37d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049223 Oct 17 07:05:36.367267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 204/414] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:36.448292 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:36.456873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8e4e9b17-88f5-4eb8-a1cf-2c56269af8f9 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.293388 Oct 17 07:05:36.457917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 211/415] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:36 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:36.638098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:36.639162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:36.657554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.661471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.663443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.664411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.666660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.674614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.790380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:36.791068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:36.798415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.798906 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.799486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.800421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:36.801028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:36.801455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:36.983248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:36.993414 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-90ba222e-b4f5-4013-b143-e8629270b51e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.362729 Oct 17 07:05:36.994219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 205/416] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:36 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:37.011365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:37.012451 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:37.018957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:37.019678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:37.020244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:37.021122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:37.021580 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:37.022005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:37.102449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:37.112566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04d9a432-1f53-492e-ac5c-2a68f6a366b8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.326798 Oct 17 07:05:37.115861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:37.119786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 212/417] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:36 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:37.124304 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8e396637-87f8-442c-b9e7-13f7dbb743e9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1298 microversion: 2.1 time: 0.128880 Oct 17 07:05:37.124890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 206/418] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:36 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:37.286733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:37.288321 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:37.295283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:37.296720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:37.297409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:37.298351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:37.299017 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:37.299701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:37.481225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:37.481849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:37.488860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:37.489678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:37.490339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:37.492027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:37.492834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:37.493469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:37.546059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:37.559517 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-05f09239-2527-4615-bbd5-7fd95f02bf67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.275543 Oct 17 07:05:37.561442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 213/419] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:37 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:37.701244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:37.718094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5bc1a9f3-60d7-40fb-a658-88f16de971a5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.241385 Oct 17 07:05:37.723841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 207/420] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:37 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:38.017838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:38.019202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:38.025189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.025689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.026110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.026980 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.027644 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.028136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.093950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-d0a87035-8673-4450-9188-fe3cfc034594 req-9e4ab088-2cf2-448e-9163-399c53522866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "name": "network-vif-plugged", "status": "completed", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:38.109788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-d0a87035-8673-4450-9188-fe3cfc034594 req-9e4ab088-2cf2-448e-9163-399c53522866 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.110511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-d0a87035-8673-4450-9188-fe3cfc034594 req-9e4ab088-2cf2-448e-9163-399c53522866 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.111291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-d0a87035-8673-4450-9188-fe3cfc034594 req-9e4ab088-2cf2-448e-9163-399c53522866 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.124702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-d0a87035-8673-4450-9188-fe3cfc034594 req-9e4ab088-2cf2-448e-9163-399c53522866 service nova] Creating event network-vif-plugged:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:05:38.130564 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-d0a87035-8673-4450-9188-fe3cfc034594 req-9e4ab088-2cf2-448e-9163-399c53522866 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040089 Oct 17 07:05:38.131333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 208/421] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:38.146448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:38.147743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:38.167644 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.170766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.171234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.171944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.172398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.172820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.204933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:38.214907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-59d22d56-b88f-4611-a012-4e82b3d2ab52 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.200718 Oct 17 07:05:38.219284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 214/422] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:38 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:38.222903 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:38.223544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:38.233199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.233691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.234181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.234895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.235476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.235919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.364812 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:38.373851 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1d48ceba-9c16-4607-ad35-fb26d4a756ec tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.231528 Oct 17 07:05:38.374436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 209/423] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:38 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:38.401891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-9c75c510-d318-4a60-b516-ec5860fad8e6 req-a47d7603-7281-48ef-b91a-ce7273c117c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1", "tag": "a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:38.412385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9c75c510-d318-4a60-b516-ec5860fad8e6 req-a47d7603-7281-48ef-b91a-ce7273c117c7 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.412855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9c75c510-d318-4a60-b516-ec5860fad8e6 req-a47d7603-7281-48ef-b91a-ce7273c117c7 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.413268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9c75c510-d318-4a60-b516-ec5860fad8e6 req-a47d7603-7281-48ef-b91a-ce7273c117c7 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.425992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-9c75c510-d318-4a60-b516-ec5860fad8e6 req-a47d7603-7281-48ef-b91a-ce7273c117c7 service nova] Creating event network-changed:a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0 for instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 on hv-cinder-84506 Oct 17 07:05:38.426210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:38.441190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-9c75c510-d318-4a60-b516-ec5860fad8e6 req-a47d7603-7281-48ef-b91a-ce7273c117c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043078 Oct 17 07:05:38.441784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 210/424] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:38.442262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-586f9ec7-f247-419a-bc43-b6fe6ff32fd6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.224176 Oct 17 07:05:38.442861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 215/425] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:38 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:38.588788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:38.589552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:38.597393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.597911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.598477 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.599363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.599817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.600234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.746844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:38.752355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:38.764081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.764567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.764992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.765895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:38.766342 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:38.766759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:38.954202 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:38.975752 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-691494a1-fe2b-4cfd-b7e8-a1f148f352fe tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.393883 Oct 17 07:05:38.994316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 211/426] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:38 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:39.043833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:39.051682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-31d0f1a7-2dc4-430c-8af4-53f3c683ca3d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.309177 Oct 17 07:05:39.052351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 216/427] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:38 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:39.238435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:39.239065 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:39.245720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.246162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.246783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.247870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.249036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.249741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.397049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:39.397595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:39.405105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.405941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.406790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.408539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.409266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.409911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.503918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:39.518184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ee97305d-0f00-4f5f-90ea-06bc77a3af00 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.283902 Oct 17 07:05:39.518920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 212/428] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:39 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:39.535588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:39.535588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:39.535588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.535588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.536062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.536062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.536363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.537023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.702973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:39.712248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eab69aed-9e21-49a6-8095-e0558b08c35d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.318969 Oct 17 07:05:39.713038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 217/429] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:39 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:39.718137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-34b13a22-e118-45f3-a1dd-8fc471f4436b req-3b559b11-5213-4594-bc58-44bf4966060a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb0d772-1540-4f77-8bbd-04827935fee4", "tag": "e353e326-79d0-4bbe-9557-0cccc6a5f68f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:39.735470 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-34b13a22-e118-45f3-a1dd-8fc471f4436b req-3b559b11-5213-4594-bc58-44bf4966060a service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:39.736124 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-34b13a22-e118-45f3-a1dd-8fc471f4436b req-3b559b11-5213-4594-bc58-44bf4966060a service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:39.736632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-34b13a22-e118-45f3-a1dd-8fc471f4436b req-3b559b11-5213-4594-bc58-44bf4966060a service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:39.766790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-34b13a22-e118-45f3-a1dd-8fc471f4436b req-3b559b11-5213-4594-bc58-44bf4966060a service nova] Creating event network-changed:e353e326-79d0-4bbe-9557-0cccc6a5f68f for instance abb0d772-1540-4f77-8bbd-04827935fee4 on hv-cinder-84506 Oct 17 07:05:39.767074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:39.780980 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-34b13a22-e118-45f3-a1dd-8fc471f4436b req-3b559b11-5213-4594-bc58-44bf4966060a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066221 Oct 17 07:05:39.781589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 218/430] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:39.781793 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-de35c991-080f-4f2d-9ab3-1cc24ff833c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.261748 Oct 17 07:05:39.782384 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 213/431] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:39 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:40.008068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:40.009556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:40.022673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.025975 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.027440 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.031251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.031943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.033068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.075523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:40.076407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:40.084565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.085048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.089371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.090114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.090575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.090999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.269240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:40.277550 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8ee98df5-bf96-43ce-b844-90efba123b4e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.276767 Oct 17 07:05:40.278115 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 219/432] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:39 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:40.297256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:40.304944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c3e2d883-016f-44e9-bd43-e43761e5438f tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.234413 Oct 17 07:05:40.305529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 214/433] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:40 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:40.544135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:40.544812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:40.551635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.552117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.552546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.553232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.553685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.554105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.572431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:40.685840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:40.693465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0109209b-7c56-40ff-b24c-eb356501965e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1357 microversion: 2.1 time: 0.154250 Oct 17 07:05:40.694087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 220/434] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:40 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:40.736893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:40.737503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:40.743808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.744297 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.744730 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.745456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.745907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.746329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.804803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:40.805465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:40.811526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.812258 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.812847 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.813725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:40.814444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:40.815022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:40.964035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:40.972406 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9741b5ca-fbae-4146-aa8b-572c46190987 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.239319 Oct 17 07:05:40.972976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 215/435] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:40 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:40.990437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:40.998842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-32ccc27f-3f31-4d14-9aab-fb8b5d8ab6d0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.198156 Oct 17 07:05:40.999424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 221/436] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:40 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:41.112947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-903598447", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "networks": [{"uuid": "141ad0c8-e75e-4ca2-a8bf-1ac4d8022b10"}]}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:41.167759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] validate_networks() for [('141ad0c8-e75e-4ca2-a8bf-1ac4d8022b10', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:05:41.300391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:41.301007 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:41.307771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.308258 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.308713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.309413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.309931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.310359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.762391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:41.770074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-75175ef4-5598-4cc4-8ed8-a1bf8861c520 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.473515 Oct 17 07:05:41.770639 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 222/437] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:41 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:41.775035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:41.775684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:41.781201 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.781682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.782111 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.783071 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.783257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.783683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.807547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:05:41.808071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:05:41.808416 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:05:41.808864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:05:41.809267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:05:41.818065 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.818530 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.818953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.819720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.820164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.820608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.837797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Getting quotas for project a3f4b1d3bce74b54ac996990fb44d782. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:05:41.841706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Getting quotas for user e65cf0e0271d4dc8adcc2bbb5ad48fb8 and project a3f4b1d3bce74b54ac996990fb44d782. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:05:41.853070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:05:41.855350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:05:41.908511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3a3edfc1-1ac7-4854-a092-1ba52f0fea20 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799194 Oct 17 07:05:41.909500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 216/438] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:05:41.920856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:41.921475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:41.924350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:41.929026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.929792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.930448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.931401 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:41.931854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:41.932271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:41.948806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3b29ce18-be61-442c-b428-6207d2164acb tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.177117 Oct 17 07:05:41.949533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 223/439] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:41 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:41.954652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0ec9493-23b8-4095-b091-e943b90836ac tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:41.958341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0ec9493-23b8-4095-b091-e943b90836ac tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.060985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0ec9493-23b8-4095-b091-e943b90836ac tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:42.076469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0ec9493-23b8-4095-b091-e943b90836ac tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1218 microversion: 2.1 time: 0.124919 Oct 17 07:05:42.088079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 224/440] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:41 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:42.092584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.093391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.100122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.100877 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.101388 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.102734 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.103287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.103778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.290162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:42.300942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a99f0b13-8165-451f-bde2-46aabdeef588 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1547 microversion: 2.1 time: 0.384141 Oct 17 07:05:42.318232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 217/441] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:41 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1547 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:42.328660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.329376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.335638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.336278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.337426 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.338191 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.338715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.339203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.428914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:42.440348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-451156f9-1173-4c75-8522-c3d338266c04 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.351409 Oct 17 07:05:42.441656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 225/442] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:42.447294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-147a9842-04dd-4f9f-b61f-befdbf5389c1 req-cfd3181e-bb69-493f-9d03-510028b1bd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78fc0d3-677f-443b-a0f5-1650adce3478", "name": "network-vif-plugged", "status": "completed", "tag": "739e5f9f-69c4-4e14-809a-e5c09082e758"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:42.458365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-147a9842-04dd-4f9f-b61f-befdbf5389c1 req-cfd3181e-bb69-493f-9d03-510028b1bd23 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.459052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-147a9842-04dd-4f9f-b61f-befdbf5389c1 req-cfd3181e-bb69-493f-9d03-510028b1bd23 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.459974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-147a9842-04dd-4f9f-b61f-befdbf5389c1 req-cfd3181e-bb69-493f-9d03-510028b1bd23 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.476611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-147a9842-04dd-4f9f-b61f-befdbf5389c1 req-cfd3181e-bb69-493f-9d03-510028b1bd23 service nova] Creating event network-vif-plugged:739e5f9f-69c4-4e14-809a-e5c09082e758 for instance b78fc0d3-677f-443b-a0f5-1650adce3478 on hv-cinder-84506 Oct 17 07:05:42.483888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-147a9842-04dd-4f9f-b61f-befdbf5389c1 req-cfd3181e-bb69-493f-9d03-510028b1bd23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Oct 17 07:05:42.485366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 226/443] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:42.492271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.493591 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.500286 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.501248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.502243 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.503569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.504216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.505069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.519223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:42.522739 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:42.527871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5324ab45-84f6-43a6-ac9f-de4d4c5a4aab tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.203845 Oct 17 07:05:42.528435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 218/444] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:42.644633 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:42.653006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ccf638db-f190-4c31-8662-49193d26c235 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1547 microversion: 2.1 time: 0.166267 Oct 17 07:05:42.653581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 227/445] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:42.675434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.678633 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.679064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.680317 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:42.681089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Searching by: {'deleted': False, 'project_id': 'db8098f6f78c49fa843d34d69b002daa'} {{(pid=118996) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 07:05:42.685869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.686678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.687834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.688087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.688560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.688662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.688989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.689087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.689540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.689702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.690151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.690567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.714262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e3751b60-88b8-412b-82a1-8d3c0de6860f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/ips" status: 200 len: 151 microversion: 2.20 time: 0.039472 Oct 17 07:05:42.714830 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 228/446] 10.222.0.36 () {60 vars in 1289 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 07:05:42.778995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.multi_cell_list [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118996) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 07:05:42.793682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.794290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.800214 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.800693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.801244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.801805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.802260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.802679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.876014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-52dd804f-3150-469d-a11f-2f562a2c1835 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204404 Oct 17 07:05:42.883835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 219/447] 10.222.0.36 () {58 vars in 1125 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:42.889178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:42.889794 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:42.895807 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.896291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.896894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.897587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:42.898193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:42.898831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:42.981168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:43.020339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-973af5bd-799e-404d-9d93-8bf96b44ee86 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.230962 Oct 17 07:05:43.021784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 229/448] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:43.035491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:43.039771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:43.049798 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:43.050279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.050788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.051794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.054533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.055898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.056347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.059410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6bbdd180-5ffe-45ce-b0ad-7ad3619ec37c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1547 microversion: 2.1 time: 0.173602 Oct 17 07:05:43.059919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 220/449] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:42 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:43.102547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:43.103464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:43.109828 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.110311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.110750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.111478 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.111923 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.112338 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.199060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:43.207453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-afba29be-33cb-4662-9b1c-d552703aef04 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1222 microversion: 2.1 time: 0.109499 Oct 17 07:05:43.219890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 221/450] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:43 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:43.232197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:43.240440 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-70c18b3b-8e24-49a2-8856-c760c56fffc8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.217533 Oct 17 07:05:43.241099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 230/451] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:43 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:43.467403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:43.468012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:43.473770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.474244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.474670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.475368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.475814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.476226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.550000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:43.550662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:43.557539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.558185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.558646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.559355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:43.559805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:43.560223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:43.615746 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:43.624568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f55b1554-a636-435c-8b49-2c7bdabc9a1a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.161049 Oct 17 07:05:43.625138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 222/452] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:43 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:43.697903 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:43.705657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0ff4d30e-839d-4be5-a2e5-d80bc93da542 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.159543 Oct 17 07:05:43.706207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 231/453] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:43 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:44.044546 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:44.045932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.054040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.055589 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.056229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.057131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.057783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.058401 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.232092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:44.232803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.239121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.239716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.240213 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.241015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.241542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.242028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.245399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:44.255285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-06b8e13d-8b9c-4633-acb2-db9f18180093 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.215693 Oct 17 07:05:44.255942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 223/454] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:44 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:44.264887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:44.265636 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.272394 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.273087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.274098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.274918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.275460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.275942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.317095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:44.325786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8b62f2af-eefb-4a97-9350-ae8a9d6ccf24 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1270 microversion: 2.1 time: 0.097697 Oct 17 07:05:44.326364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 232/455] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:44 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:44.408999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:44.416566 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-192987c1-4316-4fdd-9346-f63452b57d55 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.156566 Oct 17 07:05:44.417105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 224/456] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:44 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:44.619051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:44.619636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.626213 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.626697 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.627135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.627911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.628376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.628815 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.649206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:44.649809 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.653930 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lazy-loading 'flavor' on Instance uuid 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:44.670520 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.671009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.671463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.672152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.672774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.673192 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.807167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:44.816919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2a9aba9a-1abc-4d80-8d81-53153cae4db6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.171746 Oct 17 07:05:44.817743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 225/457] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:44 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:44.823529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b11779b-7c29-4608-911e-9c6f26a44231"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:44.826200 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.832813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.833032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.833557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.834279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.834732 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.835154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.870919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-64ea363c-bd79-4c24-a74f-dc1d5e3847ff tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/action" status: 202 len: 0 microversion: 2.20 time: 0.256470 Oct 17 07:05:44.874753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 233/458] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 17 07:05:44 2022] POST /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:05:44.876932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:44.877631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:44.884270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.884757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.885195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:44.885890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:44.886343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:44.886770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.099648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.107838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d7cd817d-ebcc-4a18-a162-0ea99d48d9d9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.235204 Oct 17 07:05:45.108393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 234/459] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:44 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:45.112758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:45.113351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:45.119364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.119843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.120275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.120957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.121407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.121831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.254901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.262873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.264352 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.265570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-632ccf10-8994-468e-8047-16fc137662a7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.156207 Oct 17 07:05:45.266070 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 235/460] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:45 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:45.277175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:45.277882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:45.283632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.284170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.284605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.285295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.285746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.286198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.423848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.433062 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d61ddff9-df80-4042-a0f0-d6e273b97c1b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.159317 Oct 17 07:05:45.443288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 236/461] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:45 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:45.443288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:45.443288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:45.449631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.449631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.449631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.449631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.450272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.450272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.454180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:45.454334 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-10b93c81-401d-482c-af9d-a2886043f402 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635215 Oct 17 07:05:45.454902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 226/462] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:05:44 2022] POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:45.503279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:45.504270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:45.515088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.515654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.516020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.516711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.517026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.517162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.519659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.531870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-870a1cb1-13d9-4db9-9de4-db9b346f63f6 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1270 microversion: 2.1 time: 0.096746 Oct 17 07:05:45.532463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 237/463] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:45 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:45.655412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.662970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a35359bf-619f-4613-9e61-f9f83e0d7ec6 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1312 microversion: 2.1 time: 0.164605 Oct 17 07:05:45.663574 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 227/464] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:45 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:45.840883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:45.841548 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:45.847889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.848370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.848804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.849478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:45.849934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:45.850351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:45.985753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:45.994605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5f771d98-8372-4184-bf21-dbc30deae756 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.157602 Oct 17 07:05:45.995172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 238/465] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:45 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:46.132100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:46.133097 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:46.139613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.140398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.141249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.142401 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.143262 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.143891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.293234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:46.294633 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:46.304078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.304580 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.305679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.306469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.306606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.307058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.307533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.315876 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6dfe52c3-69e0-4fce-8866-7eb924e62366 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.188567 Oct 17 07:05:46.316629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 228/466] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:46 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:46.406308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-83ed850f-8383-44e2-bdf5-3ae2c3b8bde3 req-8b27bcbf-26b5-4145-9b94-1dd0288c8e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1", "name": "network-vif-plugged", "status": "completed", "tag": "a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:46.417264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-83ed850f-8383-44e2-bdf5-3ae2c3b8bde3 req-8b27bcbf-26b5-4145-9b94-1dd0288c8e6c service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.417802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-83ed850f-8383-44e2-bdf5-3ae2c3b8bde3 req-8b27bcbf-26b5-4145-9b94-1dd0288c8e6c service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.418220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-83ed850f-8383-44e2-bdf5-3ae2c3b8bde3 req-8b27bcbf-26b5-4145-9b94-1dd0288c8e6c service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.430067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-83ed850f-8383-44e2-bdf5-3ae2c3b8bde3 req-8b27bcbf-26b5-4145-9b94-1dd0288c8e6c service nova] Creating event network-vif-plugged:a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0 for instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 on hv-cinder-84506 Oct 17 07:05:46.435112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-83ed850f-8383-44e2-bdf5-3ae2c3b8bde3 req-8b27bcbf-26b5-4145-9b94-1dd0288c8e6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 Oct 17 07:05:46.436911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 229/467] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:46.444081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.453844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.455849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.457200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d7e0ed3b-3f79-4d33-a2be-e73c57742264 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.169123 Oct 17 07:05:46.457314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:46.458053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 239/468] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:46 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:05:46.458293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:46.465224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.465732 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.466162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.467359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.468010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.468626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.554378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:46.555626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:46.561819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.562302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.562795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.563597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.564060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.564795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.626983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.635368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3054f774-f23a-4221-95d2-a5fab52a9a0e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.182271 Oct 17 07:05:46.636257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 230/469] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:46 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:46.644919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.652764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f46adcd1-776a-44b4-9e8d-86ef41bcac29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1270 microversion: 2.1 time: 0.102183 Oct 17 07:05:46.653318 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 240/470] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:46 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:46.687420 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:46.688030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:46.694489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.694973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.695482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.696178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:46.696626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:46.697062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:46.838441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:46.849645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7fea4858-bc59-4803-b174-c8ca9ec5d81a tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1496 microversion: 2.1 time: 0.165885 Oct 17 07:05:46.853445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 231/471] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:46 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:47.017843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.018631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.025649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.026202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.026726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.027520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.027980 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.028405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.163194 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:47.172572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-52474b87-5e83-4cbc-9b65-e2ecdc5cc04c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1722 microversion: 2.1 time: 0.158502 Oct 17 07:05:47.173242 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 241/472] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:47 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:47.338153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.338754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.344649 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.345122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.345548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.346217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.346661 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.347072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.488750 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.502740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.502872 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:47.505666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.506387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.507180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.508155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.508819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.509415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.509887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f31a375e-8ba8-4437-8091-7ec511f4fc63 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.175418 Oct 17 07:05:47.510740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 232/473] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:47 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:47.517599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.518359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.526495 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.527259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.527963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.529683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.530214 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.530654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.556972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:05:47.584997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:47.640144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:47.652623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ff7b1cf7-22e0-4b93-965d-708dd175d9c8 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 204 len: 0 microversion: 2.1 time: 0.140176 Oct 17 07:05:47.653647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 233/474] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:05:47 2022] DELETE /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:05:47.667438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.667438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.671901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.672397 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.672832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.673538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.673996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.674510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.729168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:47.737183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:47.738603 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:47.739787 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8adc98b2-692f-40fe-ab41-03843bd145a0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.259055 Oct 17 07:05:47.740335 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 242/475] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:47 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:47.744807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.745407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.751180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.752002 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.752153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.752819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.753268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.753930 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.965656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:47.976387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1c9bb454-f201-4ce6-9f53-ab0d23fd4402 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1371 microversion: 2.1 time: 0.316419 Oct 17 07:05:47.991234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 234/476] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:47 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:47.991234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:47.991234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:47.997043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.997556 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.998018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:47.998810 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:47.999299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:47.999705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.019836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.028825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0f805355-2047-4417-a94f-50a19e924802 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1502 microversion: 2.1 time: 0.287509 Oct 17 07:05:48.029392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 243/477] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:47 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:48.078342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.092361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a407f463-ec10-4e46-8cde-62fc60621d58 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1276 microversion: 2.1 time: 0.113060 Oct 17 07:05:48.093111 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 235/478] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:47 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:48.196210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:48.197089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:48.203818 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.204331 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.204763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.205515 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.206023 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.206561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.411784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.419959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a8cc898b-7f8d-4de9-af3e-cdb73753902b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1699 microversion: 2.1 time: 0.228159 Oct 17 07:05:48.420514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 244/479] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:48 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1699 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:48.442298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-60933cb8-de1b-40f8-bc4b-ec6b3577a8e0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:48.448665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60933cb8-de1b-40f8-bc4b-ec6b3577a8e0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.449144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60933cb8-de1b-40f8-bc4b-ec6b3577a8e0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.449569 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-60933cb8-de1b-40f8-bc4b-ec6b3577a8e0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.451566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-b2a9c52a-1beb-4988-b77d-6854e82f4825 req-06e0378b-b304-454b-99bb-48b4b3d96014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb0d772-1540-4f77-8bbd-04827935fee4", "name": "network-vif-plugged", "status": "completed", "tag": "e353e326-79d0-4bbe-9557-0cccc6a5f68f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:48.460900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b2a9c52a-1beb-4988-b77d-6854e82f4825 req-06e0378b-b304-454b-99bb-48b4b3d96014 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.461369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b2a9c52a-1beb-4988-b77d-6854e82f4825 req-06e0378b-b304-454b-99bb-48b4b3d96014 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.461797 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b2a9c52a-1beb-4988-b77d-6854e82f4825 req-06e0378b-b304-454b-99bb-48b4b3d96014 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.472651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-b2a9c52a-1beb-4988-b77d-6854e82f4825 req-06e0378b-b304-454b-99bb-48b4b3d96014 service nova] Creating event network-vif-plugged:e353e326-79d0-4bbe-9557-0cccc6a5f68f for instance abb0d772-1540-4f77-8bbd-04827935fee4 on hv-cinder-84506 Oct 17 07:05:48.477624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-b2a9c52a-1beb-4988-b77d-6854e82f4825 req-06e0378b-b304-454b-99bb-48b4b3d96014 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029963 Oct 17 07:05:48.478208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 245/480] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:48.510193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-60933cb8-de1b-40f8-bc4b-ec6b3577a8e0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Going to try to start instance {{(pid=118996) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 07:05:48.534069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:48.534914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:48.541340 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.541829 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.542262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.542946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.543428 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.543854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.550924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-60933cb8-de1b-40f8-bc4b-ec6b3577a8e0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action" status: 202 len: 0 microversion: 2.1 time: 0.112209 Oct 17 07:05:48.551565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 236/481] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:05:48 2022] POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:05:48.560419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:48.561121 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:48.567022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.567545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.567973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.568660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.569113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.569541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.747019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.750113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.755058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-da31dc39-3220-467d-9a7e-060c6bb547ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.225121 Oct 17 07:05:48.755909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 246/482] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:48 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:48.758653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-20f3efe2-359c-40f9-80be-a66473d68d03 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.202247 Oct 17 07:05:48.759232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 237/483] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:48 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:48.769693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:48.769693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:48.772453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.772941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.773375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.774605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:48.775054 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:48.775503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:48.911643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.920047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.921505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:48.922643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c591f437-b7c7-40a3-a325-da229ff52189 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.160707 Oct 17 07:05:48.923186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 247/484] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:48 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:05:49.000749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:49.001356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:49.007356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.008320 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.008760 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.009463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.009911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.010328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.052255 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:49.052772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:49.059127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.059645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.060074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.060751 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.061195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.061609 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.190059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:49.198318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-32be87cd-7998-44d1-a5b2-1d95f2c49d20 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1565 microversion: 2.1 time: 0.201440 Oct 17 07:05:49.198876 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 238/485] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:48 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:49.203507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:49.204108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:49.209662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.210014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.210442 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.211111 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.211628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.212048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.218676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:49.226210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-86fcbe07-2792-42bf-a166-facb42fc652c tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1502 microversion: 2.1 time: 0.177790 Oct 17 07:05:49.226800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 248/486] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:49 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:49.242104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:49.243433 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:49.249752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.250244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.250684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.251443 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.251900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.252504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.352110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-44d19e20-1496-42af-8ab6-56792f8d85b6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115694 Oct 17 07:05:49.352737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 249/487] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:05:49 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:49.379010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:49.387394 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fe058d0d-ee75-48e8-8775-4522bbb68584 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.187501 Oct 17 07:05:49.387990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 239/488] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:49 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:49.779713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:49.780435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:49.786638 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.787257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.787797 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.788727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.789816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.790337 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.794773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:49.796414 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:49.802697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.803177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.803649 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.804341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:49.805608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:49.806032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:49.986837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:49.994679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b64ee321-e879-4540-b17b-9fdbc284fde8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.220491 Oct 17 07:05:50.002567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 250/489] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:49 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:50.002884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:50.011539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-742feddc-6284-4b95-a22b-c94a73cd9023 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.233685 Oct 17 07:05:50.012126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 240/490] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:49 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:50.012724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:50.013348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:50.019505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.020019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.020438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.021383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.021597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.022027 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.150947 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:50.160555 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:50.162154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:50.163932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eea1913d-0656-4fd0-8b4a-85513c478365 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.167349 Oct 17 07:05:50.165677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 251/491] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:49 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:50.254012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:50.254730 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:50.260903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.261673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.262340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.263119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.263776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.264389 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.291520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-030f3615-38b3-4444-9bf1-806ee9872641 req-6e7a4b94-93ee-44e8-8727-98978e669c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1", "tag": "a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:50.303096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-030f3615-38b3-4444-9bf1-806ee9872641 req-6e7a4b94-93ee-44e8-8727-98978e669c5b service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.303611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-030f3615-38b3-4444-9bf1-806ee9872641 req-6e7a4b94-93ee-44e8-8727-98978e669c5b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.304049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-030f3615-38b3-4444-9bf1-806ee9872641 req-6e7a4b94-93ee-44e8-8727-98978e669c5b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.317776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-030f3615-38b3-4444-9bf1-806ee9872641 req-6e7a4b94-93ee-44e8-8727-98978e669c5b service nova] Creating event network-changed:a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0 for instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 on hv-cinder-84506 Oct 17 07:05:50.323700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-030f3615-38b3-4444-9bf1-806ee9872641 req-6e7a4b94-93ee-44e8-8727-98978e669c5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036394 Oct 17 07:05:50.327520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 252/492] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:05:50.410660 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:50.411632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:50.418281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.419013 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.419652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.420509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:50.421122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:50.422295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:50.436293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:50.446577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-77f2efd3-d5a7-451e-a57f-b64b4caf38d1 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1502 microversion: 2.1 time: 0.196422 Oct 17 07:05:50.456789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 241/493] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:50 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:50.663492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:50.672144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-599c873d-c85c-48e1-9d0e-d56cc6f672ce tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.265665 Oct 17 07:05:50.672726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 253/494] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:50 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:51.018171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:51.019176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:51.026883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.027702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.028208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.029033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.029677 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.030421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.037886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:51.040038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:51.046422 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:51.047983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.049135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.049248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.049940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.050540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.051104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.565496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:51.576805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6cd5cd25-fd7c-4771-a305-ea725b90f00d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.543747 Oct 17 07:05:51.581359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 254/495] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:51 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:51.584031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:51.584849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:51.585611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:51.591629 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.592111 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.592546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.593476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.593690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.594943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.600176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9c185e29-ec06-4e9d-95ce-abe65e215545 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.584702 Oct 17 07:05:51.600176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 242/496] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:51 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:51.617771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:51.618597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:51.619197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:51.627652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.628231 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.629764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.630485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.630944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.631413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.843666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:51.848846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=6 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:51.855719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:51.858386 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:51.861627 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-27d46032-d966-495b-b325-b2361c88ffa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.282766 Oct 17 07:05:51.884327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:51.893767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d1389a18-4b01-4d7f-8072-ec7d941c0f4d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1502 microversion: 2.1 time: 0.283523 Oct 17 07:05:51.908644 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 255/497] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:51 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:51.913640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 243/498] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:51 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:51.920922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-90d6c5ac-d010-4d1d-a84f-36fcc1811f06 req-a7dd0990-ca2e-4ee1-99f2-3f0f8c8c0f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b7b9c4-3e52-48ef-b0d1-df7e70b76e57", "tag": "24d2c2af-b02b-47ef-b2c3-b96aba9d5da6"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:51.926236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:51.926999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:51.941962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-90d6c5ac-d010-4d1d-a84f-36fcc1811f06 req-a7dd0990-ca2e-4ee1-99f2-3f0f8c8c0f0b service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.942440 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-90d6c5ac-d010-4d1d-a84f-36fcc1811f06 req-a7dd0990-ca2e-4ee1-99f2-3f0f8c8c0f0b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.942864 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-90d6c5ac-d010-4d1d-a84f-36fcc1811f06 req-a7dd0990-ca2e-4ee1-99f2-3f0f8c8c0f0b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.944132 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.944970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.946087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.946822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:51.947398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:51.947817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:51.999811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-90d6c5ac-d010-4d1d-a84f-36fcc1811f06 req-a7dd0990-ca2e-4ee1-99f2-3f0f8c8c0f0b service nova] Creating event network-changed:24d2c2af-b02b-47ef-b2c3-b96aba9d5da6 for instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 on hv-cinder-84506 Oct 17 07:05:52.020265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-90d6c5ac-d010-4d1d-a84f-36fcc1811f06 req-a7dd0990-ca2e-4ee1-99f2-3f0f8c8c0f0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110233 Oct 17 07:05:52.023778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 256/499] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:52.315355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:52.324359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fc5ce704-871a-4a11-9dcd-91bf4d7eb400 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.409605 Oct 17 07:05:52.324921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 244/500] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:51 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:52.596983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:52.600547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:52.601080 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-52346b90-64b5-4eff-8b87-54f33442957b req-54dea273-36aa-4dec-b7f6-2b508c4b524b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78fc0d3-677f-443b-a0f5-1650adce3478", "name": "network-vif-deleted", "tag": "739e5f9f-69c4-4e14-809a-e5c09082e758"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:52.601231 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:52.607184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.607693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.608153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.608839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.609343 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.609759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.610778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-52346b90-64b5-4eff-8b87-54f33442957b req-54dea273-36aa-4dec-b7f6-2b508c4b524b service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.611275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-52346b90-64b5-4eff-8b87-54f33442957b req-54dea273-36aa-4dec-b7f6-2b508c4b524b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.611706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-52346b90-64b5-4eff-8b87-54f33442957b req-54dea273-36aa-4dec-b7f6-2b508c4b524b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.622861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-52346b90-64b5-4eff-8b87-54f33442957b req-54dea273-36aa-4dec-b7f6-2b508c4b524b service nova] Creating event network-vif-deleted:739e5f9f-69c4-4e14-809a-e5c09082e758 for instance b78fc0d3-677f-443b-a0f5-1650adce3478 on hv-cinder-84506 Oct 17 07:05:52.627698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-52346b90-64b5-4eff-8b87-54f33442957b req-54dea273-36aa-4dec-b7f6-2b508c4b524b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Oct 17 07:05:52.628272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 257/501] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:52.635698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:52.636415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:52.642469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.642946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.643405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.644087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.644555 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.644973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.722010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=4 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:52.955799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:52.964043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e05cdd80-5dbd-490b-bd99-ce820af9c267 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.367393 Oct 17 07:05:52.964610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 245/502] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:52 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:52.969138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:52.969745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:52.976085 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.976575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.977012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.977707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:52.978153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:52.978506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:52.978644 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:52.987272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f934435c-c39c-4655-ba41-00ded332adc2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.356539 Oct 17 07:05:52.987837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 258/503] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:52 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:52.992860 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:52.993671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:52.999658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.000201 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.000619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.001305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.001797 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.002214 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.083894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:53.094903 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6333206b-bfea-4261-894d-c81c1fe60519 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1297 microversion: 2.1 time: 0.106066 Oct 17 07:05:53.095842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 259/504] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:52 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:53.141610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:53.152060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:53.153766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:53.155007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-86df437e-5b33-4bc6-805b-7018a33a6210 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.189482 Oct 17 07:05:53.155982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 246/505] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:52 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:53.206750 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:53.207407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:53.213410 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.213893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.214329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.215018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.215496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.215921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.340995 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:53.347475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:53.348108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:53.349183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a5efb599-20d7-4653-82cb-914f7bb19b75 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1593 microversion: 2.1 time: 0.146328 Oct 17 07:05:53.349742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 260/506] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:53 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1593 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:53.354556 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.355038 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.355498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.356425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.356946 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.357436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.675152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:53.684242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7dfe0512-85cd-4a4f-9158-15cd5812e6a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.340491 Oct 17 07:05:53.685003 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 247/507] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:53 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:53.986817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:53.987472 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:53.993586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.994061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.994483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:53.995161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:53.995632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:53.996044 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.010824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:54.011459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:54.017990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.018480 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.018921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.020520 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.021164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.021592 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.043248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:05:54.244137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.268602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.269306 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dd9e152d-11fd-4c90-b112-12157fa3ab15 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1366 microversion: 2.1 time: 0.262357 Oct 17 07:05:54.279250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 248/508] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:54 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:54.282388 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0c6d2317-b52a-48ee-8656-ce8fb12056ee tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.299544 Oct 17 07:05:54.283472 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 261/509] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:53 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:54.284534 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:54.285278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:54.288569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:54.289236 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:54.298418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.299538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.300236 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.300666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.301493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.301874 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.302178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.302873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.302971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.303347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.303766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.304061 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.341188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.341574 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.342002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.342447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid b78fc0d3-677f-443b-a0f5-1650adce3478 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:54.406843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.414941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3530023c-ea85-4665-b535-6d2393ea3df5 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1302 microversion: 2.1 time: 0.135953 Oct 17 07:05:54.415563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 249/510] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:54 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:54.475948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.484524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.485964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.487123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-febb0643-d9f3-4c27-818a-8f5036cdea8e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.202590 Oct 17 07:05:54.487765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 262/511] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:54 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:54.727690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:54.728298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:54.734147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.734622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.735046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.735754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:54.736197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:54.736610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:54.871762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:54.879826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-78325f6d-6f57-41ef-86c0-1c86f1c0e49a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.156319 Oct 17 07:05:54.880410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 250/512] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:54 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:55.294209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:55.294829 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:55.301431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.302118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.302725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.303444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.303895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.304318 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.306572 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:55.307431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:55.315138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.315650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.316211 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.316912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.317361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.317775 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.501313 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:55.512077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2dfaf295-abf3-4bc5-961c-b729c31c2fcf tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1556 microversion: 2.1 time: 0.221938 Oct 17 07:05:55.512896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 263/513] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:55 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:55.527905 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:55.537255 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:55.537981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:55.542054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f278f070-f444-451a-a59b-22b419e3dee5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.239908 Oct 17 07:05:55.544771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.545544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.546229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.547114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.547812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.548447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.554303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 251/514] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:55 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:55.565547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-b67f8d05-0fc7-48e5-8fad-d7c857e0c2da req-6ea5861e-316d-458d-a0a5-ee82d713f3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:55.586619 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-b67f8d05-0fc7-48e5-8fad-d7c857e0c2da req-6ea5861e-316d-458d-a0a5-ee82d713f3e4 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.587102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-b67f8d05-0fc7-48e5-8fad-d7c857e0c2da req-6ea5861e-316d-458d-a0a5-ee82d713f3e4 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.587564 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-b67f8d05-0fc7-48e5-8fad-d7c857e0c2da req-6ea5861e-316d-458d-a0a5-ee82d713f3e4 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.597444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.597932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.598363 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.599010 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid b78fc0d3-677f-443b-a0f5-1650adce3478 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:55.599997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-b67f8d05-0fc7-48e5-8fad-d7c857e0c2da req-6ea5861e-316d-458d-a0a5-ee82d713f3e4 service nova] Creating event network-changed:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:05:55.606298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-b67f8d05-0fc7-48e5-8fad-d7c857e0c2da req-6ea5861e-316d-458d-a0a5-ee82d713f3e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049524 Oct 17 07:05:55.607462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 252/515] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:55.613434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:55.614147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:55.621287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.621850 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.622291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.623024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.623504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.623933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.689953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:55.698482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5da1f306-179d-4557-8f6e-248aa97311a4 tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1302 microversion: 2.1 time: 0.168333 Oct 17 07:05:55.700301 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 264/516] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:55 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1302 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:55.705478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:55.706234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:55.712419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.713084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.713656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.714497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.715159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.715891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.832358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-51444a02-b47b-42fc-9a0e-49b1536b1ade tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130740 Oct 17 07:05:55.833107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 265/517] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:05:55 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:55.903519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:55.910970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:55.912281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:55.916444 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:55.918525 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:55.921004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f5453614-bfa5-48b2-90b4-95ab12bffece tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.311924 Oct 17 07:05:55.921731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 253/518] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:55 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:55.939041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.944514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.944514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:55.945351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:55.945726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:55.946146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:56.280144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:56.288240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-082406c8-f929-4ada-bb9f-dfa3800e2711 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.389728 Oct 17 07:05:56.300074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 266/519] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:55 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:05:56.570497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:56.571381 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:56.578895 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:56.579587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:56.580145 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:56.580919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:56.581449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:56.581942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:56.725855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:56.727487 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:56.735842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:56.736601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:56.737201 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:56.738192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:56.738658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:56.739076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:56.773790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:56.774285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:56.774748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:56.775697 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lazy-loading 'fault' on Instance uuid b78fc0d3-677f-443b-a0f5-1650adce3478 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:05:56.986602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e07169459e44b079cbcc5157874c89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdf05cfb044a2aa98bc12a38fb76cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:56.994508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ddba86f7-8724-4f14-a6cb-e62f1741734d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 200 len: 1302 microversion: 2.1 time: 0.272586 Oct 17 07:05:57.008237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 267/520] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:56 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 1302 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:57.016452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:57.017060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:57.025346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:57.027164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:57.028394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:57.029275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:57.029881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:57.031728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:57.334622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:57.344661 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4ffe536e-8eca-498e-96ed-c95c6d6eb27e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1708 microversion: 2.1 time: 0.778540 Oct 17 07:05:57.345584 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 254/521] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:56 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1708 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:57.350365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:57.351189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:57.357791 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:57.358465 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:57.359571 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:57.361544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:57.362723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:57.363476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:57.520537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:57.532659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:57.534496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:57.535945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7406a48f-3493-4671-9b20-737f5d908c3a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.526614 Oct 17 07:05:57.536738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 268/522] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:57 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:05:57.581691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-677880669"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:57.582263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:57.588940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:57.589434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:57.589872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:57.590563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:57.591054 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:57.591510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:57.662445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:57.672511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-06e25a95-c536-4b13-ba9d-d069528f5653 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.325583 Oct 17 07:05:57.673103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 255/523] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:57 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:57.807869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.network.security_group_api [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Adding security group 7f90909c-50f6-468e-b1f8-9fee810f0132 to port c02e456f-4c7d-4e27-b8ff-de4e7755400c Oct 17 07:05:58.021543 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:58.022163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] [instance: b78fc0d3-677f-443b-a0f5-1650adce3478] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:58.028925 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.029715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.030208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.031259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.031811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.032445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.047431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] HTTP exception thrown: Instance b78fc0d3-677f-443b-a0f5-1650adce3478 could not be found. Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Request method failure captured: Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 HTTP/1.1 Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP6OteQ4nhbCQv3albFeC3Bbxb9HQfz-nlOm7-anJl-gDxnt22L5QVZkCyBEnK7KCrBq2XfDQcauvlhr77ke7h64222yUWY-kPw4QqSUkcSIRUsLSaMeIvsEPNMrtyeN6aHE3sHGqmr66wgw4ktkVRwjasX9NKgyDOapoe6TF-HpwTI Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 58fdf05cfb044a2aa98bc12a38fb76cd Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesActionsTest-1612480862 Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:05:58.049307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/58fdf05cfb044a2aa98bc12a38fb76cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/58fdf05cfb044a2aa98bc12a38fb76cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/58fdf05cfb044a2aa98bc12a38fb76cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_58fdf05cfb044a2aa98bc12a38fb76cd"}]}] Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesActionsTest-1612480862 Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 58fdf05cfb044a2aa98bc12a38fb76cd Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesActionsTest-1612480862 Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesActionsTest-1612480862-project Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 2e07169459e44b079cbcc5157874c89a Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesActionsTest-1612480862-project Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance b78fc0d3-677f-443b-a0f5-1650adce3478 could not be found. Oct 17 07:05:58.050626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'b78fc0d3-677f-443b-a0f5-1650adce3478'} Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78fc0d3-677f-443b-a0f5-1650adce3478 could not be found. Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:05:58.051433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78fc0d3-677f-443b-a0f5-1650adce3478 could not be found. Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78fc0d3-677f-443b-a0f5-1650adce3478 could not be found. Oct 17 07:05:58.052709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:05:58.054505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] Returning 404 to user: Instance b78fc0d3-677f-443b-a0f5-1650adce3478 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:05:58.054505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-38d87aa0-67cb-4cd7-ba13-043544c6041d tempest-VolumesActionsTest-1612480862 tempest-VolumesActionsTest-1612480862-project] 10.222.0.36 "GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478" status: 404 len: 111 microversion: 2.1 time: 0.033093 Oct 17 07:05:58.054505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 256/524] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:58 2022] GET /compute/v2.1/servers/b78fc0d3-677f-443b-a0f5-1650adce3478 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:05:58.059560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-de7153f3-5f17-4a0e-992c-7b055a3620a1 req-dbb30199-aedd-479a-8f73-224149b069a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb0d772-1540-4f77-8bbd-04827935fee4", "tag": "e353e326-79d0-4bbe-9557-0cccc6a5f68f"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:05:58.069662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-de7153f3-5f17-4a0e-992c-7b055a3620a1 req-dbb30199-aedd-479a-8f73-224149b069a8 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.070639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-de7153f3-5f17-4a0e-992c-7b055a3620a1 req-dbb30199-aedd-479a-8f73-224149b069a8 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.071058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-de7153f3-5f17-4a0e-992c-7b055a3620a1 req-dbb30199-aedd-479a-8f73-224149b069a8 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.089044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-de7153f3-5f17-4a0e-992c-7b055a3620a1 req-dbb30199-aedd-479a-8f73-224149b069a8 service nova] Creating event network-changed:e353e326-79d0-4bbe-9557-0cccc6a5f68f for instance abb0d772-1540-4f77-8bbd-04827935fee4 on hv-cinder-84506 Oct 17 07:05:58.094645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-de7153f3-5f17-4a0e-992c-7b055a3620a1 req-dbb30199-aedd-479a-8f73-224149b069a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042088 Oct 17 07:05:58.095648 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 257/525] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:05:58.279920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c54779d5-0b7d-4d44-a3e2-f4a83a910ed4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.702287 Oct 17 07:05:58.287557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 269/526] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:05:57 2022] POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:05:58.291985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:58.293887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:58.303087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.303659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.304086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.305536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.305986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.306407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.377658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:58.378298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:58.397210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.398875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.399406 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.403519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.405598 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.406212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.742576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:58.747041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:58.756434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d5150644-0b6a-4ef2-8696-39d831d145c1 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1712 microversion: 2.1 time: 0.391329 Oct 17 07:05:58.771886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 270/527] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:58 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1712 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:58.779997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:58.780542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:58.787270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.787765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.788196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.790460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e98703bb-68e0-4c07-9918-11e11659aa59 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1639 microversion: 2.1 time: 0.504325 Oct 17 07:05:58.800200 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 258/528] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:58 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1639 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:58.801979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.802485 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.802933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.825422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:05:58.826043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:05:58.833285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.833783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.834217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:58.834924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:05:58.835605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:05:58.836749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:05:59.162835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:59.166553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:59.172664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c1a17c17-50f4-45e4-8614-a4d6ff435dd9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.371138 Oct 17 07:05:59.173256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 259/529] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:05:58 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:05:59.175100 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:59.176643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:05:59.177805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5f882779-d17c-499d-a89e-136b26116e40 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.404879 Oct 17 07:05:59.178703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 271/530] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:05:58 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:00.113156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-2796370e-3c89-4802-93c4-1a0a9337355c req-171421d0-2246-43dc-ad4b-8e19caf27b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:00.123705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2796370e-3c89-4802-93c4-1a0a9337355c req-171421d0-2246-43dc-ad4b-8e19caf27b6d service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:00.124173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2796370e-3c89-4802-93c4-1a0a9337355c req-171421d0-2246-43dc-ad4b-8e19caf27b6d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:00.124588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2796370e-3c89-4802-93c4-1a0a9337355c req-171421d0-2246-43dc-ad4b-8e19caf27b6d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:00.135541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-2796370e-3c89-4802-93c4-1a0a9337355c req-171421d0-2246-43dc-ad4b-8e19caf27b6d service nova] Creating event network-changed:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:06:00.140411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-2796370e-3c89-4802-93c4-1a0a9337355c req-171421d0-2246-43dc-ad4b-8e19caf27b6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030853 Oct 17 07:06:00.141133 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 260/531] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:06:00.194649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:00.195540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:00.202176 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:00.202649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:00.203076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:00.203780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:00.204247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:00.204643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:00.212625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:00.213347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:00.219421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:00.219902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:00.220327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:00.221064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:00.221507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:00.221924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:00.398331 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:00.402912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:00.406912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e6f3992b-e5a8-4fa9-9165-56ce46f418a3 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.216021 Oct 17 07:06:00.407596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 272/532] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:00 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:00.411072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:00.412540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:00.413739 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ce18aac0-a8ca-48ef-a4f0-6f309f17d865 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.205319 Oct 17 07:06:00.414279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 261/533] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:00 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:01.430098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:01.430711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:01.437354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:01.437839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:01.438276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:01.439121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:01.439305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:01.439715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:01.439912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:01.440107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:01.446217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:01.446686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:01.447110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:01.447822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:01.448266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:01.448681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:01.458366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:01.633102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:01.636517 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:01.642269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:01.644033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:01.645437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2bbaef94-87ad-4f04-81fb-decc14134362 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.210009 Oct 17 07:06:01.645945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1130974d-61e0-47cc-97c0-29d6d4fb3b82 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.219621 Oct 17 07:06:01.646530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 273/534] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:01 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:01.647282 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 262/535] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:01 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:02.670467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:02.671157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:02.671687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:02.672296 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:02.678074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:02.678595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:02.678708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:02.679071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:02.679285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:02.680096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:02.680466 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:02.680616 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:02.681389 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:02.681545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:02.681986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:02.682409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:02.895817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:02.899250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:02.906015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:02.907797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:02.907949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cde3a5ac-a6f1-4b8f-a16a-89b33ecfca9e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.241873 Oct 17 07:06:02.908366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 274/536] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:02 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:02.909067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-edb9b513-bc97-41fe-8f10-5e7ee17a3fa5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.241227 Oct 17 07:06:02.909649 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 263/537] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:02 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:03.932445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:03.933042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:03.937596 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:03.938215 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:03.939361 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:03.939992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:03.940433 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:03.941267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:03.941723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:03.942186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:03.944867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:03.945351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:03.945784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:03.946473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:03.947085 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:03.947537 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:04.177560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:04.193364 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:04.194855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:04.195870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:04.198765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-88a38efc-8c12-4426-b0e0-c81ba0a74f38 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1743 microversion: 2.20 time: 0.264728 Oct 17 07:06:04.200021 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 264/538] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:03 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:04.203409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d8e2d4c3-9816-45d6-baa1-33df67b905a5 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.275495 Oct 17 07:06:04.222347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 275/539] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:03 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:05.237291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:05.237844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:05.244672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:05.245262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:05.256172 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:05.258254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:05.259372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:05.260557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:05.261163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:05.261759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:05.262634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:05.263531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:05.264160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:05.264794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:05.265224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:05.268359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:05.971964 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:05.977209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:05.983662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5bd67560-5a69-4532-b545-70080d66d791 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.750176 Oct 17 07:06:05.986476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 265/540] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:05 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:05.995898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-c7a5c474-6fa6-4d9d-a32c-0487d7252ce5 req-d00938ba-cba2-4181-93ab-2a8c0eb31ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b7b9c4-3e52-48ef-b0d1-df7e70b76e57", "name": "network-vif-plugged", "status": "completed", "tag": "24d2c2af-b02b-47ef-b2c3-b96aba9d5da6"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:06.001229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:06.004635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:06.007708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6e9301ce-675e-4ca8-92a0-6a564217569a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1743 microversion: 2.20 time: 0.767317 Oct 17 07:06:06.008287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 276/541] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:05 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1743 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:06.010346 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c7a5c474-6fa6-4d9d-a32c-0487d7252ce5 req-d00938ba-cba2-4181-93ab-2a8c0eb31ada service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:06.011054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c7a5c474-6fa6-4d9d-a32c-0487d7252ce5 req-d00938ba-cba2-4181-93ab-2a8c0eb31ada service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:06.011896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c7a5c474-6fa6-4d9d-a32c-0487d7252ce5 req-d00938ba-cba2-4181-93ab-2a8c0eb31ada service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:06.048801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-c7a5c474-6fa6-4d9d-a32c-0487d7252ce5 req-d00938ba-cba2-4181-93ab-2a8c0eb31ada service nova] Creating event network-vif-plugged:24d2c2af-b02b-47ef-b2c3-b96aba9d5da6 for instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 on hv-cinder-84506 Oct 17 07:06:06.054926 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-c7a5c474-6fa6-4d9d-a32c-0487d7252ce5 req-d00938ba-cba2-4181-93ab-2a8c0eb31ada service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066668 Oct 17 07:06:06.059861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 266/542] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:06:07.011949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:07.012689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:07.046154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:07.046154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:07.046154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:07.046154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:07.046687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:07.046687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:07.058755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:07.059636 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:07.072953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:07.077974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:07.078736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:07.079638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:07.084080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:07.084773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:07.324800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:07.334750 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0df44924-232e-499f-bd03-3ac1313df535 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.329556 Oct 17 07:06:07.337757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 277/543] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:07 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:07.367422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:07.378322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:07.380333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:07.382079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b2a37eb0-16d0-456a-bc5b-84d5f93dc90b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.334944 Oct 17 07:06:07.383256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 267/544] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:07 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:08.074837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-4065b616-6063-44bd-aeac-7b6ffc4ca262 req-a1e808e1-5ec3-4b13-a5c0-cec5c859f1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "name": "network-vif-plugged", "status": "completed", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:08.093987 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4065b616-6063-44bd-aeac-7b6ffc4ca262 req-a1e808e1-5ec3-4b13-a5c0-cec5c859f1ac service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:08.099238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4065b616-6063-44bd-aeac-7b6ffc4ca262 req-a1e808e1-5ec3-4b13-a5c0-cec5c859f1ac service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:08.100186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4065b616-6063-44bd-aeac-7b6ffc4ca262 req-a1e808e1-5ec3-4b13-a5c0-cec5c859f1ac service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:08.132605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-4065b616-6063-44bd-aeac-7b6ffc4ca262 req-a1e808e1-5ec3-4b13-a5c0-cec5c859f1ac service nova] Creating event network-vif-plugged:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:06:08.138412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-4065b616-6063-44bd-aeac-7b6ffc4ca262 req-a1e808e1-5ec3-4b13-a5c0-cec5c859f1ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067286 Oct 17 07:06:08.139132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 278/545] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:06:08.361124 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:08.361686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:08.381859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:08.382375 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:08.383035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:08.384010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:08.385005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:08.385733 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:08.390591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:08.418513 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:08.419584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:08.433170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:08.434036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:08.434799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:08.439003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:08.439937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:08.440632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:08.728694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:08.747771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1d1e0666-e405-4268-88b1-d80b8281a321 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1318 microversion: 2.1 time: 0.382439 Oct 17 07:06:08.766430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 268/546] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:08 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:08.957436 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:08.972615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:08.976007 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:08.982621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0d598790-c592-4131-a672-f9ed2c21a3d5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.565439 Oct 17 07:06:08.986569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 279/547] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:08 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:09.777248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:09.778526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:09.792715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:09.793486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:09.794085 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:09.794959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:09.808001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:09.808886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:10.025239 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:10.026042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:10.033772 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:10.039245 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:10.039956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:10.040932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:10.041645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:10.042097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:10.042520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:10.050935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-01ac313e-a1ac-4932-98f0-a4fd8abc4501 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1508 microversion: 2.1 time: 0.280804 Oct 17 07:06:10.052478 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 269/548] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:09 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:06:10.395717 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:10.409979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:10.412111 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:10.416896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e445ab59-e34a-4ec5-aef2-53ad0481aabe tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.395741 Oct 17 07:06:10.432109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 280/549] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:10 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:11.447341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:11.448886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:11.464136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:11.464944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:11.466607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:11.469602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:11.471229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:11.472434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:11.780840 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:11.796673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:11.801032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:11.804749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0f2e6c3d-81f3-484e-b183-f119e3d52d99 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.362638 Oct 17 07:06:11.806474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 270/550] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:11 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:12.832246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:12.833804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:12.856788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:12.858243 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:12.859018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:12.859942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:12.860596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:12.861222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:13.128543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:13.143241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:13.145516 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:13.146990 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-22922784-a134-44fa-a346-a168a28348a6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.318711 Oct 17 07:06:13.161532 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 281/551] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:12 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:14.177486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:14.178744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:14.197982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:14.198632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:14.199228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:14.205922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:14.206602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:14.209104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:14.443943 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:14.455933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:14.457560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:14.459012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6983903c-1ad9-405d-a221-fd148449ac01 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.286385 Oct 17 07:06:14.487448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 271/552] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:14 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:06:15.490737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:15.491484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:15.510775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:15.511295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:15.511739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:15.512450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:15.512904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:15.513346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:15.788844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:15.799454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:15.800936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:15.802134 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-98510655-4acd-460e-af9c-f4f4d808aca8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.315497 Oct 17 07:06:15.820900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 282/553] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:15 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:16.832604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:16.834565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:16.843742 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:16.844938 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:16.845644 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:16.846640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:16.847378 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:16.849987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:17.067247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:17.081930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:17.083701 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:17.084918 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4982e39c-039b-4034-a98f-f40f209ced77 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.258004 Oct 17 07:06:17.087533 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 272/554] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:16 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:18.115087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:18.115780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:18.125400 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:18.127057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:18.127799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:18.129147 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:18.130046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:18.130495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:18.299540 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:18.310302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:18.312606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:18.314556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aebefcba-34bf-480c-9071-46c9b12167f9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1738 microversion: 2.20 time: 0.204130 Oct 17 07:06:18.315359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 283/555] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:18 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:19.350182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:19.351418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:19.353689 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:19.367778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:19.367778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:19.367778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:19.367778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:19.368695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:19.368695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:19.506516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:19.515431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:19.516875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:19.518037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-57d2d29c-b615-4db2-aedb-8f1b42f78329 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1720 microversion: 2.20 time: 0.172002 Oct 17 07:06:19.518590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 273/556] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:19 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:20.553771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:20.556489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:20.567185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:20.567991 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:20.573069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:20.574238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:20.574769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:20.575519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:20.711506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:20.722132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:20.724394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:20.729956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8c078e19-1047-459a-8e56-685d5c24576e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1720 microversion: 2.20 time: 0.190768 Oct 17 07:06:20.731893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 284/557] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:20 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:20.846138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-aae584ef-5e23-4094-9ba7-114d73ccfbca req-fa683b54-45b1-4058-bc99-fc014cbe8137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "name": "network-vif-unplugged", "status": "completed", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:20.858162 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-aae584ef-5e23-4094-9ba7-114d73ccfbca req-fa683b54-45b1-4058-bc99-fc014cbe8137 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:20.858731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-aae584ef-5e23-4094-9ba7-114d73ccfbca req-fa683b54-45b1-4058-bc99-fc014cbe8137 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:20.859425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-aae584ef-5e23-4094-9ba7-114d73ccfbca req-fa683b54-45b1-4058-bc99-fc014cbe8137 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:20.871339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-aae584ef-5e23-4094-9ba7-114d73ccfbca req-fa683b54-45b1-4058-bc99-fc014cbe8137 service nova] Creating event network-vif-unplugged:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:06:20.877149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-aae584ef-5e23-4094-9ba7-114d73ccfbca req-fa683b54-45b1-4058-bc99-fc014cbe8137 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034698 Oct 17 07:06:20.878591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 274/558] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:06:21.758152 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:21.759604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:21.762300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=66 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:21.768707 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:21.769190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:21.769805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:21.770500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:21.771321 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:21.771699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:21.983791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:21.998235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:22.003694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:22.005590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-49c39c8b-9dea-40a8-a594-1ea1af2255aa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1723 microversion: 2.20 time: 0.251383 Oct 17 07:06:22.006899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 285/559] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:21 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:22.034064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6125aedd-7fec-4e35-89cc-48068444b022"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:22.036512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:22.043686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:22.044172 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:22.044602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:22.045511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:22.045937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:22.046367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:22.374009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e77b4dd6-17bb-47e7-a95a-dbde99c1cda2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344660 Oct 17 07:06:22.375096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 275/560] 10.222.0.36 () {62 vars in 1364 bytes} [Mon Oct 17 07:06:22 2022] POST /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:06:22.523912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:22.525747 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:22.536321 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:22.536904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:22.537447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:22.538460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:22.539250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:22.539951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:22.618861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118995) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 07:06:22.717008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a9e363b8-0575-487f-bf45-7f2fa70d9520 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/action" status: 202 len: 0 microversion: 2.20 time: 0.199510 Oct 17 07:06:22.718144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 286/561] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 17 07:06:22 2022] POST /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:06:22.726881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:22.728630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:22.736526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:22.737137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:22.737602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:22.738549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:22.739196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:22.739665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:22.942901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:22.953020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:22.954764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:22.955990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bd88af76-7c6c-433b-82f7-79cc35d5c19e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1749 microversion: 2.20 time: 0.233770 Oct 17 07:06:22.956544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 276/562] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:22 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1749 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:23.983714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:23.984365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:23.990454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:23.990942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:23.991709 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:23.992567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:23.993121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:23.993549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:24.149078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:24.159300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:24.161052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:24.162612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-83704ef4-a734-49c1-8b26-ce1772fb2375 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1749 microversion: 2.20 time: 0.184275 Oct 17 07:06:24.163395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 287/563] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:23 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:25.190347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:25.191174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:25.198589 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:25.199150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:25.199605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:25.200672 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:25.201144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:25.201691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:25.354038 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:25.362803 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:25.364277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:25.365434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f4df58b3-c48e-4041-adca-0085997d0eda tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1751 microversion: 2.20 time: 0.180642 Oct 17 07:06:25.370199 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 277/564] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:25 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:26.398301 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:26.401755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:26.412714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:26.414672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:26.415945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:26.416740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:26.417208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:26.417663 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:26.612674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:26.628183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:26.630828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:26.632456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bcf2fe7e-a74a-4ed1-a306-2b4810bdfe76 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.243409 Oct 17 07:06:26.633152 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 288/565] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:26 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:27.663587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:27.664720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:27.672473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:27.673248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:27.673837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:27.674705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:27.675344 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:27.675976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:27.817006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:27.838090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:27.843956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:27.845183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0f454186-0336-466c-a3b2-24ce93a2684c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.185570 Oct 17 07:06:27.845766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 278/566] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:27 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:28.870486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:28.871095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:28.877528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:28.878008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:28.878441 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:28.879136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:28.879611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:28.880031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:29.033370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:29.036796 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:29.043525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:29.044974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:29.046143 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-265ef876-0404-4514-bb77-d50450ed1f4b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.179531 Oct 17 07:06:29.046709 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 289/567] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:28 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:30.071438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:30.072272 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:30.078921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:30.079443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:30.079880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:30.080584 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:30.081040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:30.081462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:30.232072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:30.241748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:30.243242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:30.244429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fa102a14-8602-4fc4-b41d-60422b010b34 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.177040 Oct 17 07:06:30.244992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 279/568] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:30 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:31.272790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:31.273338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:31.281671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:31.282150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:31.282581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:31.283291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:31.283747 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:31.284171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:31.422395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:31.431394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:31.432842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:31.434022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e110b4b9-06ea-493b-8318-1aa42d441d73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.165182 Oct 17 07:06:31.434792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 290/569] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:31 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:32.462104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:32.462723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:32.469043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:32.469516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:32.469942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:32.470620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:32.471064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:32.471510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:32.614093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:32.622598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:32.624065 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:32.625206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0f0c2622-a4eb-42f9-b745-5154fd52a139 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.167863 Oct 17 07:06:32.625763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 280/570] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:32 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:33.651408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:33.652011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:33.658508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:33.658981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:33.659445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:33.660128 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:33.660573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:33.660989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:33.794944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:33.803507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:33.804938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:33.806135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-26bd60a8-e906-4786-b98e-9f781ea808df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.158797 Oct 17 07:06:33.806685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 291/571] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:33 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:34.831721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:34.832346 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:34.841001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:34.841493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:34.842188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:34.842898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:34.843387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:34.844003 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:34.984614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:34.993897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:34.995371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:34.996533 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-99a6ce27-f8ad-4b0b-9d2c-d9beb4e6bd56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.168986 Oct 17 07:06:34.997095 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 281/572] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:34 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:36.022300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:36.022909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:36.029462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:36.029932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:36.030357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:36.031030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:36.031501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:36.031917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:36.182655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:36.191526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:36.192986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:36.194163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d4f689f5-ade7-44f8-bd30-432eea8e4b4c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.176077 Oct 17 07:06:36.194720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 292/573] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:36 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:37.221045 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:37.221663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:37.228388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:37.228864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:37.229292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:37.229969 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:37.230419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:37.230838 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:37.370356 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:37.373906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:37.379849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:37.381269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:37.382408 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7199b216-8ccc-4556-b98a-caf3e265a821 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.165362 Oct 17 07:06:37.383002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 282/574] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:37 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:38.409742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:38.410349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:38.417417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:38.417890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:38.418317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:38.418991 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:38.419469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:38.419887 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:38.574286 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:38.583680 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:38.585139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:38.586828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a93f442b-e8c9-41f7-8e46-9e25f6a90809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.180588 Oct 17 07:06:38.587415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 293/575] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:38 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:39.613101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:39.613772 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:39.621695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:39.622170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:39.622597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:39.623305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:39.623753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:39.624170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:39.756736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:39.766709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:39.768109 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:39.769293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-eb6afe9d-ea94-401d-b0fc-f4db516b01a4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.160075 Oct 17 07:06:39.769843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 283/576] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:39 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:40.795362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:40.795994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:40.802790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:40.803294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:40.803726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:40.804431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:40.804879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:40.805356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:40.937501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:40.946843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:40.948298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:40.949431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ac8134c5-10ce-441c-9687-7ed97f6f08b4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.158028 Oct 17 07:06:40.949978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 294/577] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:40 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:41.974919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:41.975529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:41.982407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:41.982884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:41.983341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:41.984018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:41.984466 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:41.984883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:42.115040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:42.124226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:42.125663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:42.126804 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-555ea99b-6bec-4042-b1cc-7894372eb1bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.155755 Oct 17 07:06:42.127393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 284/578] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:41 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:43.154403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:43.155050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:43.161583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:43.162070 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:43.162510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:43.163231 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:43.163687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:43.164113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:43.295163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:43.303709 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:43.305156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:43.306298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-996b900a-b7ff-453c-ab74-0df15017ee26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.156261 Oct 17 07:06:43.306856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 295/579] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:43 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:44.331610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:44.332226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:44.341419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:44.341419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:44.341419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:44.341954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:44.342308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:44.342734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:44.504153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:44.512613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:44.514108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:44.515280 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d5e2bd64-4bc2-4d02-a9ef-fec542171163 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.187498 Oct 17 07:06:44.515864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 285/580] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:44 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:45.544533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:45.545373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:45.552003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:45.552477 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:45.553048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:45.554044 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:45.554715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:45.555139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:45.683738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:45.692154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:45.693584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:45.694727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-69977f26-8411-49e5-8dba-76fdb4e92008 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.157294 Oct 17 07:06:45.695322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 296/581] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:45 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:45.898722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d48c1e4e-a39e-41dd-be9a-9c477e5dd10b", "device": "/dev/sdb"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:45.902280 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:45.908996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:45.909479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:45.910024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:45.910760 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:45.911314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:45.911739 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:45.975114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:45.977513 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:45.984018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:45.984498 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:45.984923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:45.985608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:45.986053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:45.986475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:46.058243 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dba7a94d-c8c3-4ad2-bdd1-121c160f0286 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.086642 Oct 17 07:06:46.059419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 297/582] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:06:45 2022] POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:06:46.069833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:46.070789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:46.077559 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:46.078081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:46.078081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:46.079193 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:46.079670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:46.080095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:46.239711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:46.249099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-44121fee-6c53-4f04-b3b6-d942b849a116 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1749 microversion: 2.1 time: 0.183645 Oct 17 07:06:46.249680 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 298/583] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:46 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:06:46.263051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-edbcb596-03fa-4f99-a580-8ac2835aee84 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "POST /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368055 Oct 17 07:06:46.263778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 286/584] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:06:45 2022] POST /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:06:46.720856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:46.721469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:46.727919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:46.728462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:46.728901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:46.729594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:46.730049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:46.730478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:46.858473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:46.867468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:46.869426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:46.870582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-86207128-4193-472d-8c38-8821c1939840 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.153678 Oct 17 07:06:46.871138 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 299/585] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:46 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:47.274746 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:47.275982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:47.282036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:47.282509 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:47.282927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:47.283638 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:47.284086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:47.284499 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:47.428542 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:47.437419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-224ced2f-cd9c-403c-b370-03f714582f0c tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.167621 Oct 17 07:06:47.437980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 287/586] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:47 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:47.896537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:47.897073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:47.903549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:47.904033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:47.904471 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:47.905158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:47.905613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:47.906035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:48.039339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:48.049312 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:48.050747 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:48.051929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0b263a13-5ea9-4a98-b8a9-d1be9174f6b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.159379 Oct 17 07:06:48.052475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 300/587] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:47 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:48.461699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:48.462297 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:48.468721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:48.469198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:48.469629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:48.470309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:48.470760 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:48.471193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:48.610768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:48.619601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-937fbb94-5c14-4f75-a073-0f87d3fdf79e tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.161185 Oct 17 07:06:48.620373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 288/588] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:48 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:49.077773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:49.078383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:49.085150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:49.085938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:49.086165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:49.086931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:49.087434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:49.088113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:49.223172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:49.232267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:49.233704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:49.234857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-28fd1293-008e-4d30-9c67-271eb4ca3316 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.161244 Oct 17 07:06:49.235446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 301/589] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:49 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:49.643496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:49.644122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:49.646516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=32 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:49.652057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:49.652584 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:49.653068 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:49.653843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:49.654473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:49.654945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:49.794856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:49.803014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-012b4a8a-e8a0-4c24-81f6-93db04179ac2 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.163337 Oct 17 07:06:49.803698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 289/590] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:49 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:50.263005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:50.263579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:50.270086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:50.270570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:50.271004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:50.271729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:50.272183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:50.272611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:50.401485 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:50.410098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:50.411501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:50.412651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3cb01049-572a-4620-af69-fc786a8a7688 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.153601 Oct 17 07:06:50.413195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 302/591] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:50 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:50.826651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:50.827292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:50.833647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:50.834121 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:50.834552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:50.835255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:50.835707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:50.836131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:50.981756 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:50.990310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-14c9ca88-3a4d-452a-85ab-9302ec31bf98 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.168165 Oct 17 07:06:50.990884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 290/592] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:50 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:51.439432 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:51.440072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:51.446673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:51.447152 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:51.447695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:51.448379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:51.448831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:51.449251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:51.574989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:51.585177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:51.586961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:51.588159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0874fe62-65a2-45b1-8e3a-9d25a7d3bdf0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.152628 Oct 17 07:06:51.588873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 303/593] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:51 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:52.014236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:52.014849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:52.021310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:52.021786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:52.022215 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:52.022894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:52.023385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:52.023806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:52.166782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:52.174924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-068a2e10-261b-4631-941a-9e88b6e2de32 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.164581 Oct 17 07:06:52.175527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 291/594] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:52 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:06:52.614194 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:52.614831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:52.617259 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:52.622941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:52.623460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:52.623890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:52.624585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:52.625036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:52.625458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:52.753690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:52.762245 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:52.763702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:52.764839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c24f542-92dc-477b-aea8-44337d7cee6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.154543 Oct 17 07:06:52.765386 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 304/595] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:52 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:53.059603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-2d150897-a99e-46e3-9ab3-5869ddc23fe0 req-5e08b85d-4e5d-4efb-a833-e352c73b9135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "name": "network-vif-plugged", "status": "completed", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:53.070667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2d150897-a99e-46e3-9ab3-5869ddc23fe0 req-5e08b85d-4e5d-4efb-a833-e352c73b9135 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:53.071151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2d150897-a99e-46e3-9ab3-5869ddc23fe0 req-5e08b85d-4e5d-4efb-a833-e352c73b9135 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:53.072091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2d150897-a99e-46e3-9ab3-5869ddc23fe0 req-5e08b85d-4e5d-4efb-a833-e352c73b9135 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:53.083790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-2d150897-a99e-46e3-9ab3-5869ddc23fe0 req-5e08b85d-4e5d-4efb-a833-e352c73b9135 service nova] Creating event network-vif-plugged:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:06:53.089531 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-2d150897-a99e-46e3-9ab3-5869ddc23fe0 req-5e08b85d-4e5d-4efb-a833-e352c73b9135 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033734 Oct 17 07:06:53.090338 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 292/596] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:06:53.198449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:53.199057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:53.205190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:53.205687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:53.206102 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:53.206784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:53.207253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:53.207707 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:53.226096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:53.352394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:53.361153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c505042e-6556-461e-b829-24bfb0243a8d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.167194 Oct 17 07:06:53.361713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 305/597] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:53 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:53.792059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:53.792789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:53.798900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:53.799419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:53.799855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:53.800542 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:53.800998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:53.801420 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:53.929314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:53.937981 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:53.939464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:53.940611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-92a2dc1f-19d1-4262-925b-a9ff1b1b1c5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.153447 Oct 17 07:06:53.941164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 293/598] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:53 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:54.384840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:54.385453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:54.391951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:54.392431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:54.392869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:54.393563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:54.394025 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:54.394453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:54.531492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:54.539621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a563cc5d-babc-441a-a758-61f25eeec4e7 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.159178 Oct 17 07:06:54.540183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 306/599] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:54 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:54.966906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:54.967545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:54.973921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:54.974408 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:54.974844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:54.975558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:54.976015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:54.976439 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:55.109119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:55.117761 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:55.120303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:55.121474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-351f59fb-b747-46d3-accd-1ea83d755a05 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.158946 Oct 17 07:06:55.122040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 294/600] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:54 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:55.563078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:55.564397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:55.571041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:55.571553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:55.572542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:55.573233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:55.573682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:55.574159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:55.715084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:55.723428 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-91fe9869-1657-40d8-888f-80c00955a8bb tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.164219 Oct 17 07:06:55.723989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 307/601] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:55 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:56.147161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:56.147782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:56.156410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:56.156897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:56.157727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:56.158006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:56.158454 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:56.158873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:56.298148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:56.308015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:56.309448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:56.310591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7a32f035-1baa-40a5-bc35-402cd747f4ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.167550 Oct 17 07:06:56.311147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 295/602] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:56 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:56.745834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:56.746441 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:56.753054 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:56.753533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:56.753961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:56.754663 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:56.755095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:56.755532 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:56.905404 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:56.915146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1fffbcee-7045-41ce-9a48-8582163fc2c4 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.173153 Oct 17 07:06:56.915755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 308/603] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:56 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:57.336284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:57.336887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:57.344298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:57.344775 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:57.345197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:57.345877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:57.346324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:57.346736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:57.475811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:57.484422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:57.485995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:57.487288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-795472eb-f067-4c8f-ac33-60527e9737fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.154801 Oct 17 07:06:57.487845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 296/604] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:57 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:57.938689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:57.939332 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:57.945842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:57.946325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:57.947384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:57.948076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:57.948534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:57.948960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:58.085929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:58.094083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-968475b7-894d-4c1c-b992-8d588ffd10d9 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.159332 Oct 17 07:06:58.094645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 309/605] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:57 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:06:58.512586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:58.513190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:58.519597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:58.520074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:58.520497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:58.521173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:58.521617 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:58.522032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:58.650241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:58.658632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:58.660096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:58.661235 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bea93f35-38f4-4074-b203-c8ffc8689fa6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.152499 Oct 17 07:06:58.661786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 297/606] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:58 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:06:58.933583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c599eefe-ad4b-46b0-ba46-2ef236422374"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:06:58.936021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:58.941993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:58.942527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:58.942899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:58.943612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:58.944067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:58.944490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:59.116409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:59.117020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:59.122872 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:59.123425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:59.123862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:59.124554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:59.125013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:59.125436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:59.267674 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:59.271192 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:06:59.277125 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-69f8da0c-98ba-4808-a957-0746f7bcbee5 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.164615 Oct 17 07:06:59.277693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 298/607] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:06:59 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:06:59.687230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:06:59.687868 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:06:59.695433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:59.695917 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:59.696351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:59.697090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:06:59.697544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:06:59.697968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:06:59.827412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:59.835933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:59.837372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:06:59.838525 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-36c07182-b12d-47ac-82de-36e7f3833d36 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.155363 Oct 17 07:06:59.839084 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 299/608] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:06:59 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:07:00.129978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-942526e3-b06d-44eb-b91a-38bb4dfeeef7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.199931 Oct 17 07:07:00.130581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 310/609] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:06:58 2022] POST /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 194 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:00.299351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:00.299967 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:00.306526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:00.307020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:00.307496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:00.308393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:00.309012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:00.309595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:00.459934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:00.468227 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-211269cd-691f-4e45-b1b5-98c93519fd4f tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.172740 Oct 17 07:07:00.468779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 300/610] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:00 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:00.864255 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:00.864951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:00.871510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:00.871981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:00.872408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:00.873082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:00.873530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:00.873945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:00.999938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:01.008495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:01.009963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:01.011099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-78861071-e080-4590-817b-3eb6f604f497 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.151134 Oct 17 07:07:01.011683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 311/611] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:00 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:01.491370 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:01.491983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:01.498934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:01.499456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:01.499889 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:01.500573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:01.501027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:01.501445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:01.637980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:01.646112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7ba30673-1016-40f1-b271-d3d9cd955cc1 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.158601 Oct 17 07:07:01.646675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 301/612] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:01 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:02.036767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:02.037378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:02.044228 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:02.044701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:02.045127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:02.045803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:02.046246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:02.046662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:02.175613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:02.184966 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:02.186426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:02.187618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6ffe3d74-991f-4520-a0a8-dcb29a6a5b73 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.154699 Oct 17 07:07:02.188172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 312/613] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:02 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:02.669766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:02.670376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:02.676809 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:02.677284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:02.677736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:02.678420 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:02.678870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:02.679318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:02.816058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:02.824780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cd40f8af-d34e-4988-9172-c68a00855562 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.158889 Oct 17 07:07:02.825608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 302/614] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:02 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:03.213953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:03.214555 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:03.221018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:03.221493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:03.221923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:03.222594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:03.223036 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:03.223478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:03.359776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:03.369484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:03.371095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:03.372593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-14140c38-ba46-4002-9f5a-4a524bc3f7df tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.163082 Oct 17 07:07:03.373795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 313/615] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:03 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:03.492664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:03.493154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:03.499075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:03.499668 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:03.500098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:03.500786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:03.501237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:03.501662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:03.627606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lazy-loading 'services' on Instance uuid 69682426-13b0-4029-8721-6832e661201a {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:03.739535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-eac356b2-4772-473d-84fa-e3636870916a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-volume_attachments/25afe28d-fb4a-420f-a83b-2e41e8049f59" status: 202 len: 0 microversion: 2.1 time: 0.250628 Oct 17 07:07:03.740137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 303/616] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:07:03 2022] DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-volume_attachments/25afe28d-fb4a-420f-a83b-2e41e8049f59 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:07:03.848428 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:03.849037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:03.854910 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:03.855429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:03.855862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:03.856546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:03.856992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:03.857410 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:03.993843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:04.001879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f18113c9-47a9-45f2-98a0-86885c0f5222 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.157323 Oct 17 07:07:04.002438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 314/617] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:03 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:04.420254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:04.420977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:04.427254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.427705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.428131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.428808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.429252 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.429667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.490424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:04.491022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:04.498939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.499453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.499882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.500582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.501029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.501475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.526320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1aad88bd-63be-4c4e-987d-e5a27a65a44f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/ips" status: 200 len: 149 microversion: 2.1 time: 0.039614 Oct 17 07:07:04.526898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 315/618] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:07:04 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:07:04.540811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31b1347c-5ada-4032-9567-d7ad184f0b1d"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:04.543312 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:04.549105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.549586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.550014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.550694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.551143 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.551583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.568523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:04.577413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:04.578869 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:04.580064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-23a26f54-5c1e-4e33-9b8b-e85dfa5ae105 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.164101 Oct 17 07:07:04.580920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 304/619] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:04 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:04.633263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Invalid volume: volume 31b1347c-5ada-4032-9567-d7ad184f0b1d is already attached to instances: e5ca5f24-f6d6-4847-a8b9-d6155ad652db Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/os-volume_attachments HTTP/1.1 Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 74 Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:07:04.635045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {"volumeAttachment": {"volumeId": "31b1347c-5ada-4032-9567-d7ad184f0b1d"}} Oct 17 07:07:04.636647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Invalid volume: volume 31b1347c-5ada-4032-9567-d7ad184f0b1d is already attached to instances: e5ca5f24-f6d6-4847-a8b9-d6155ad652db Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'server_id': 'abb0d772-1540-4f77-8bbd-04827935fee4', 'body': {'volumeAttachment': {'volumeId': '31b1347c-5ada-4032-9567-d7ad184f0b1d'}}} Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 31b1347c-5ada-4032-9567-d7ad184f0b1d is already attached to instances: e5ca5f24-f6d6-4847-a8b9-d6155ad652db Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:04.637527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 31b1347c-5ada-4032-9567-d7ad184f0b1d is already attached to instances: e5ca5f24-f6d6-4847-a8b9-d6155ad652db Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:04.638894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 31b1347c-5ada-4032-9567-d7ad184f0b1d is already attached to instances: e5ca5f24-f6d6-4847-a8b9-d6155ad652db Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 400 to user: Invalid volume: volume 31b1347c-5ada-4032-9567-d7ad184f0b1d is already attached to instances: e5ca5f24-f6d6-4847-a8b9-d6155ad652db {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-823cccdd-1e64-4c33-8c38-b0e446c39d5d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100311 Oct 17 07:07:04.640338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 316/620] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:07:04 2022] POST /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 07:07:04.645290 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:04.645787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:04.652379 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.652859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.653295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.653977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.654436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.654860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.680098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:07:04.753801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-74677fd7-ad21-4066-a7b3-5658e3b5f4b1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 204 len: 0 microversion: 2.1 time: 0.112052 Oct 17 07:07:04.754452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 305/621] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:07:04 2022] DELETE /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:07:04.762603 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:04.763273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:04.769109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.769600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.770038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.770727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:04.771192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:04.771629 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:04.900961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:04.909068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd4892f6-a23d-4f88-baab-3a68745768fe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.150258 Oct 17 07:07:04.909632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 317/622] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:04 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:05.025832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:05.026441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:05.032227 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:05.032701 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:05.033131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:05.033801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:05.034241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:05.034655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:05.173444 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:05.181498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-aec8fb94-c01a-4f86-8c64-2916ab875bad tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.160544 Oct 17 07:07:05.182063 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 306/623] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:05 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:05.605896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:05.606505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:05.612929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:05.613408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:05.613843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:05.614531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:05.614983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:05.615439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:05.746824 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:05.755492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:05.756940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:05.758426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8b99d5bf-bdfd-4af4-b62a-d2d992df1acc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.156187 Oct 17 07:07:05.758744 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 318/624] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:05 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:05.933177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:05.933788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:05.940083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:05.940563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:05.940992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:05.941679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:05.942119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:05.942535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:06.067327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:06.074911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c3f979b0-0763-458d-8396-57d06e7bd2c3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.146293 Oct 17 07:07:06.075769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 307/625] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:05 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:06.205155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:06.205767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:06.211743 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:06.212710 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:06.213142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:06.213820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:06.214267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:06.214685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:06.354873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:06.363086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4b19ef67-44b4-4899-bb5f-620cadf207ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.161752 Oct 17 07:07:06.363672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 319/626] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:06 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:06.784268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:06.785011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:06.791726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:06.791837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:06.792340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:06.793391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:06.793743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:06.794005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:06.969132 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:06.980977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:06.982658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:06.984189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5ac12b42-5cc0-4b9d-8e88-7375cc840d13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.204966 Oct 17 07:07:06.984985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 308/627] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:06 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:07.099458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:07.100074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:07.107040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:07.107551 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:07.107986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:07.108673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:07.109123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:07.109544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:07.239283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:07.247518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a2ce5ee4-9ea6-4ecf-9e5e-4c22aea1a5f4 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.151970 Oct 17 07:07:07.248075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 320/628] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:07 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:07.386340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:07.386873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:07.392934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:07.393411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:07.393840 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:07.394515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:07.394970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:07.395414 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:07.536629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:07.545386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1e3f0d1e-5ddb-437e-99dc-18143d7db036 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.163039 Oct 17 07:07:07.545947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 309/629] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:07 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:08.009685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:08.010347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:08.016826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:08.016826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:08.017342 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:08.017927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:08.018448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:08.018792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:08.022970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:08.143515 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:08.152209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:08.153645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:08.154793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ca64becf-917c-4f84-86f8-45776d0dbef2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.148989 Oct 17 07:07:08.155364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 321/630] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:08 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:08.270337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:08.270972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:08.277775 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:08.278251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:08.278677 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:08.279377 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:08.279825 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:08.280240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:08.406293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:08.413792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4fb446c8-7ae7-4524-b2eb-b537ef230c77 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.147277 Oct 17 07:07:08.414357 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 310/631] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:08 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:08.568512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:08.569117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:08.574986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:08.575749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:08.576176 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:08.576849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:08.577295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:08.577708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:08.716185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:08.724361 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-231f8a50-b6df-4d4d-aac5-ee0718067419 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.159680 Oct 17 07:07:08.724919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 322/632] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:08 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:09.180472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:09.181082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:09.187617 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:09.188097 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:09.188526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:09.189208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:09.189687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:09.190105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:09.317262 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:09.326503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:09.327982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:09.329141 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-97ff7dc3-1949-484a-8e12-1b0912094938 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.152558 Oct 17 07:07:09.329708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 311/633] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:09 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:09.437971 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:09.438521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:09.444909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:09.445378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:09.445803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:09.446478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:09.446924 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:09.447364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:09.573561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:09.581399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c511a418-0677-46d9-92fb-b855d24703f8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.147401 Oct 17 07:07:09.581951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 323/634] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:09 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:09.747171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:09.747842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:09.753675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:09.754163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:09.754629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:09.755353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:09.755812 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:09.756238 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:09.894247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:09.902941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5d6e4808-70da-4b2c-b06e-f0f753f29f78 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.159486 Oct 17 07:07:09.903532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 312/635] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:09 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:10.357249 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:10.357814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:10.363732 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:10.364215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:10.364646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:10.365329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:10.365780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:10.366199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:10.493110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:10.502206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:10.503689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:10.504839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-38ef1d7e-bf26-4ca3-a9f3-cfa3e1220878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1807 microversion: 2.20 time: 0.151735 Oct 17 07:07:10.505385 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 324/636] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:10 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:10.604349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:10.604958 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:10.611330 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:10.611768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:10.612201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:10.612919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:10.613373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:10.613792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:10.617808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:10.745040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:10.752955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-34efe6e8-d0cf-4089-9723-0e25b12d9b29 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.152251 Oct 17 07:07:10.753622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 313/637] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:10 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:10.926599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:10.927378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:10.934097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:10.934658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:10.935168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:10.935953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:10.936487 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:10.936922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:11.096019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:11.104183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7f81b109-b34c-407d-a247-9f1d759071bd tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.182242 Oct 17 07:07:11.104738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 325/638] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:10 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:11.530625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:11.531157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:11.537022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:11.537526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:11.537950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:11.538622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:11.539064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:11.539501 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:11.668495 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:11.677608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:11.679103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:11.680803 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d4e62d97-ce5e-4908-9885-63adad8574ee tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1794 microversion: 2.20 time: 0.153942 Oct 17 07:07:11.681365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 314/639] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:07:11 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:07:11.779022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:11.779653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:11.786445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:11.786860 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:11.787311 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:11.788000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:11.788447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:11.788882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:11.919167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:11.927362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-762760eb-7d7c-424c-bafc-1926e05b82bb tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.153504 Oct 17 07:07:11.927923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 326/640] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:11 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:12.128518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:12.129160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:12.135258 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:12.135744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:12.136186 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:12.137430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:12.137878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:12.138299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:12.283021 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:12.291112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8ae0c930-bbec-4577-ab62-1d89bd6f3a6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.166869 Oct 17 07:07:12.291727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 315/641] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:12 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:12.954774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:12.957167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:12.971524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:12.972358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:12.972988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:12.974035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:12.974651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:12.975077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:13.182411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:13.191488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ee2157ea-bb04-4605-b7fb-3f48505e9884 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1680 microversion: 2.1 time: 0.243399 Oct 17 07:07:13.192030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 327/642] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:12 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:13.318376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:13.319831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:13.330276 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:13.331083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:13.331739 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:13.333453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:13.334402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:13.335059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:13.635941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:13.645436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b0edeab9-7e07-4a64-be2a-7c54e791c43b tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1754 microversion: 2.1 time: 0.332549 Oct 17 07:07:13.646042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 316/643] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:13 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1754 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:13.721304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-3e71bff8-ff25-4546-8873-c806766533df req-6fa16e46-1a6d-40ce-8fbd-17fd353b57d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb0d772-1540-4f77-8bbd-04827935fee4", "name": "network-vif-deleted", "tag": "e353e326-79d0-4bbe-9557-0cccc6a5f68f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:13.733668 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-3e71bff8-ff25-4546-8873-c806766533df req-6fa16e46-1a6d-40ce-8fbd-17fd353b57d5 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:13.734080 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-3e71bff8-ff25-4546-8873-c806766533df req-6fa16e46-1a6d-40ce-8fbd-17fd353b57d5 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:13.734662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-3e71bff8-ff25-4546-8873-c806766533df req-6fa16e46-1a6d-40ce-8fbd-17fd353b57d5 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:13.752701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-3e71bff8-ff25-4546-8873-c806766533df req-6fa16e46-1a6d-40ce-8fbd-17fd353b57d5 service nova] Creating event network-vif-deleted:e353e326-79d0-4bbe-9557-0cccc6a5f68f for instance abb0d772-1540-4f77-8bbd-04827935fee4 on hv-cinder-84506 Oct 17 07:07:13.760482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-3e71bff8-ff25-4546-8873-c806766533df req-6fa16e46-1a6d-40ce-8fbd-17fd353b57d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042896 Oct 17 07:07:13.761105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 328/644] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:14.215904 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:14.216645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:14.222748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:14.223479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:14.223908 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:14.224790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:14.225244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:14.225675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:14.258275 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:14.259026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:14.259533 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:14.260028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lazy-loading 'fault' on Instance uuid abb0d772-1540-4f77-8bbd-04827935fee4 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:14.302977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:14.311526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-62a154e3-08d3-47be-97dd-a2fc80091f4c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 200 len: 1330 microversion: 2.1 time: 0.100148 Oct 17 07:07:14.312787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 317/645] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:14 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:14.671225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:14.673260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:14.686749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:14.687547 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:14.688210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:14.688980 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:14.689502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:14.690009 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:14.859084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:14.867449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cd4d56f7-caf3-41b7-8f29-c876bfbd3b40 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1757 microversion: 2.1 time: 0.201129 Oct 17 07:07:14.868328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 329/646] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:14 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:15.335300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:15.336030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:15.343070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:15.343592 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:15.344035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:15.344715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:15.345163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:15.345584 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:15.360618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 HTTP/1.1 Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:07:15.362250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:07:15.363708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'abb0d772-1540-4f77-8bbd-04827935fee4'} Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:07:15.364515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:07:15.365781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:15.366970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:07:15.366970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f25251b0-fee3-411b-aacd-c32a9925d2c8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 404 len: 111 microversion: 2.1 time: 0.032304 Oct 17 07:07:15.366970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 318/647] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:15 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:07:15.373989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f2c4bb02-1642-4e0d-a706-949ca5b2eada tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '.version_select at 0x7f4acd2885e0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:15.397626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f2c4bb02-1642-4e0d-a706-949ca5b2eada tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43968653" status: 202 len: 0 microversion: 2.1 time: 0.027915 Oct 17 07:07:15.398699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 330/648] 10.222.0.36 () {58 vars in 1215 bytes} [Mon Oct 17 07:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43968653 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:07:16.084107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:16.084613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:16.091140 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:16.091629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:16.092058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:16.092740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:16.093192 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:16.093611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:16.186323 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lazy-loading 'services' on Instance uuid e5ca5f24-f6d6-4847-a8b9-d6155ad652db {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:16.263923 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-620a942e-adcc-4bd3-bc8d-c3c53d5546ba tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments/31b1347c-5ada-4032-9567-d7ad184f0b1d" status: 202 len: 0 microversion: 2.1 time: 0.183597 Oct 17 07:07:16.264830 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 319/649] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:07:16 2022] DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments/31b1347c-5ada-4032-9567-d7ad184f0b1d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:07:16.273738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:16.275937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:16.283352 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:16.283976 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:16.284510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:16.285207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:16.285688 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:16.286060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:16.318450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-41c2b570-52b7-4543-b4b9-0715538b56ee tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049118 Oct 17 07:07:16.319061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 331/650] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:16 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:16.319321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:16.319959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:16.326829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:16.327328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:16.327754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:16.328433 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:16.328882 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:16.329295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:16.562545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lazy-loading 'services' on Instance uuid 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:16.634611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c3cefb98-0bf4-4389-a82a-ffde1c714deb tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57/os-volume_attachments/d48c1e4e-a39e-41dd-be9a-9c477e5dd10b" status: 202 len: 0 microversion: 2.1 time: 0.319295 Oct 17 07:07:16.635192 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 320/651] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:07:16 2022] DELETE /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57/os-volume_attachments/d48c1e4e-a39e-41dd-be9a-9c477e5dd10b => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:07:17.331113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:17.333311 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:17.339805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:17.340288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:17.340722 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:17.341408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:17.341893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:17.342317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:17.374078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-412098ef-c82e-4b0a-94b1-31e3f447477a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Oct 17 07:07:17.374634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 332/652] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:17 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:18.387725 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:18.390032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:18.396100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:18.396579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:18.397009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:18.397693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:18.398144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:18.398564 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:18.427944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bfea9301-8d66-4352-bba4-80d00e2c8fcd tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045706 Oct 17 07:07:18.428512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 321/653] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:18 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:19.440571 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:19.442765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:19.449733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:19.450212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:19.450901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:19.451618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:19.452070 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:19.452493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:19.481413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f062485a-6518-4fc4-8ede-0b56b4d6ed56 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Oct 17 07:07:19.481960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 333/654] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:19 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:20.467643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:20.469857 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:20.472340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:20.477544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.478026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.478456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.479148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.479647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.480075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.494291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:20.496656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:20.504228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lazy-loading 'flavor' on Instance uuid 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:20.508031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.508834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.509345 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.510336 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.511534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.512181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.560817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6f0d4d04-ad40-4cb1-a705-ca8d6b86450a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070141 Oct 17 07:07:20.566221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 334/655] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:20 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:07:20.674574 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1b39fcef-1918-4d1a-ac30-61954cead5f2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/action" status: 200 len: 32 microversion: 2.1 time: 0.211671 Oct 17 07:07:20.675176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 322/656] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:07:20 2022] POST /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:07:20.684721 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:20.685343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:20.691273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.691758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.692196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.692885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.693341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.693766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.819012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-31452411-e820-471f-b5ae-caff3f57bb9d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:20.820934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:20.826435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31452411-e820-471f-b5ae-caff3f57bb9d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.826920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31452411-e820-471f-b5ae-caff3f57bb9d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.827561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31452411-e820-471f-b5ae-caff3f57bb9d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.830376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-256affb7-12af-4a6d-a3de-ffce4b591977 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.149469 Oct 17 07:07:20.830816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 335/657] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:20 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:20.851763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-31452411-e820-471f-b5ae-caff3f57bb9d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Going to try to stop instance {{(pid=118996) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 07:07:20.898770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-31452411-e820-471f-b5ae-caff3f57bb9d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action" status: 202 len: 0 microversion: 2.1 time: 0.083821 Oct 17 07:07:20.899422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 323/658] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:07:20 2022] POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:07:20.907514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:20.908122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:20.914256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.914745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.915185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:20.915905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:20.916355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:20.916786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:21.064379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:21.072296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-342d6c5a-ad5e-42b5-a085-c4712429596d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.168607 Oct 17 07:07:21.072863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 336/659] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:20 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:21.575028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:21.577785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:21.584187 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:21.584590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:21.585163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:21.585973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:21.586625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:21.587240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:21.618723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e46129af-3a3a-4d73-b6e0-38f6db1986c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Oct 17 07:07:21.623308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 324/660] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:21 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:21.854181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:21.855355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:21.861713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:21.862194 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:21.862630 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:21.863344 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:21.863849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:21.864273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:21.990892 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:21.999814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-01be3b59-9ba6-400b-b9db-e6d98306e0c3 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.149483 Oct 17 07:07:22.000433 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 337/661] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:21 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:22.096099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:22.096714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:22.102691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.103170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.103636 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.104319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.105381 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.105802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.237221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:22.241007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:22.245856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9d469539-7860-4b1f-94c4-e37ccdd9d9ac tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.153646 Oct 17 07:07:22.246410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 325/662] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:22 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:22.631002 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:22.633233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:22.635189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:22.640594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.641075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.641504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.642188 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.642649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.643067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.673401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d993d181-4af8-40cb-b8b6-e9e381fde830 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046318 Oct 17 07:07:22.673962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 338/663] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:07:22 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 07:07:22.737164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:22.737666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:22.745317 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.746301 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.746734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.747446 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.747901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.748339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.775737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:07:22.863943 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a1336d49-e028-446b-bb17-d9fefb4fd1a6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 204 len: 0 microversion: 2.1 time: 0.130226 Oct 17 07:07:22.864922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 326/664] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:07:22 2022] DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:07:22.873474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:22.874524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:22.881842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.882274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.882700 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.883536 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:22.885116 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:22.885618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:22.905112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:23.015463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:23.025838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fa865b30-dbb0-4e32-a8ee-ad0ec5ee2e90 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1680 microversion: 2.1 time: 0.156500 Oct 17 07:07:23.028915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:23.031978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:23.038647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:23.039137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:23.039711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:23.039879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 339/665] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:22 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:23.041276 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:23.042787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:23.043462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:23.177729 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:23.186148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d014db6b-3981-4dc7-8706-3cad4ac25610 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.166833 Oct 17 07:07:23.186705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 327/666] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:23 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:23.268488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:23.269094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:23.275027 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:23.275660 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:23.276073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:23.277199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:23.277645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:23.278060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:23.411713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:23.419476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-41e6a209-85f8-4dfe-9ecb-feece00e5230 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.154881 Oct 17 07:07:23.420073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 340/667] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:23 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:24.051051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:24.051693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:24.058457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.058930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.059392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.060067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.060508 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.060920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.138205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:24.138781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:24.150701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.156674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.157331 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.158323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.158846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.159514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.187634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:07:24.206090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:24.213615 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-37cc9a6f-91fc-4ea3-a4d3-0485d46f7fda tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1680 microversion: 2.1 time: 0.166220 Oct 17 07:07:24.214827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 328/668] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:24 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:24.235189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:24.235825 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:24.241628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.242110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.242537 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.243329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.243979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.244571 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.284271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e03ef79a-9896-4ee9-a1d0-de686a228a26 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 204 len: 0 microversion: 2.1 time: 0.150907 Oct 17 07:07:24.284968 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 341/669] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:07:24 2022] DELETE /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 07:07:24.293224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:24.293913 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:24.299773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.300287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.300715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.301395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.301844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.302266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.498576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:24.506595 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6305fa70-6198-488a-8944-5f7f9b08e7fc tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.278039 Oct 17 07:07:24.507161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 329/670] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:24 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:24.511576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:24.512161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:24.517785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.518259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.518696 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.519741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:24.519860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:24.520220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:24.538309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:24.548077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-461c1c96-ec0c-42a1-9383-57665220fe8f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1560 microversion: 2.1 time: 0.258787 Oct 17 07:07:24.559472 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 342/671] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:24 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:24.677739 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:24.686000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-29849899-b67c-4d4a-9ab1-f7a0d70785a3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.177847 Oct 17 07:07:24.686568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 330/672] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:24 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:25.241177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:25.241798 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:25.248247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.248737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.249214 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.249888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.250332 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.250776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.379849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:25.388546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b350d7e5-71ab-4ed1-8b25-8c3f7156eda2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1680 microversion: 2.1 time: 0.151228 Oct 17 07:07:25.389104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 343/673] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:25 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:25.529735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:25.530343 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:25.536646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.537127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.537553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.538230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.538681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.539097 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.572302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:25.573932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:25.580337 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.580999 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.581603 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.582455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.583046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.583500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.734340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:25.743400 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-52615c9e-392a-4446-bc04-4719f2f0b9ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.217493 Oct 17 07:07:25.744206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 331/674] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:25 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:25.749607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:25.750210 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:25.756137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.756614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.757208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.758049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:25.758665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:25.759087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:25.771063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:25.779981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-86da4faf-14e4-4b08-89a4-5961d650aa12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1514 microversion: 2.1 time: 0.211512 Oct 17 07:07:25.780635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 344/675] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:25 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:25.897118 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:25.904893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8fc267e0-9593-455e-b40e-53a25c380264 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.159400 Oct 17 07:07:25.905456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 332/676] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:25 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:26.412554 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:26.413182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:26.420614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.421109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.421543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.422253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.422714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.423140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.550640 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:26.558671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0a27cd9-d9cd-47b3-bed0-a8e691c2674b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1680 microversion: 2.1 time: 0.150014 Oct 17 07:07:26.559256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 345/677] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:26 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:26.769079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:26.769612 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:26.775974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.776460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.776891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.777570 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.778020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.778438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.801663 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:26.802375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:26.809072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.809667 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.810200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.811015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.811502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.811924 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.960181 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:26.968906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-10354a6b-063c-40bc-9a68-3751ce8d9f07 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.203738 Oct 17 07:07:26.969561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 333/678] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:26 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:26.974230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:26.974898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:26.983354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:26.986472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.986973 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.987510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.988285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:26.988738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:26.989161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:26.991364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-674c1aee-3e74-488a-bd12-af7a78c8ec0e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1514 microversion: 2.1 time: 0.193447 Oct 17 07:07:26.992046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 346/679] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:26 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:27.117487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:27.125673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-28487702-07c8-416b-96da-868d79496d77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.155098 Oct 17 07:07:27.126237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 334/680] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:26 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:27.582103 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:27.582720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:27.589204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:27.589682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:27.590119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:27.590799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:27.591271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:27.591694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:27.716107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:27.723777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-485607fa-2658-4af7-b5a0-bf253674abb7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1680 microversion: 2.1 time: 0.145494 Oct 17 07:07:27.724338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 347/681] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:27 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:27.993924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:27.994535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:28.000541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.001025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.001457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.002139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.002588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.003009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.013865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:28.014587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:28.020631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.021113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.021546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.022233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.022684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.023108 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.268404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:28.277215 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9a1faf97-3e4a-4d3a-bcae-adc55529545e tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.287750 Oct 17 07:07:28.277921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 335/682] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:27 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:28.286010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:28.286832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:28.296458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.296956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.297392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.298097 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.298551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.298975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.301773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:28.310237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-00c48172-160f-4f4a-996a-1e65e90ea3e9 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1514 microversion: 2.1 time: 0.300183 Oct 17 07:07:28.323251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 348/683] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:28 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:28.529669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:28.538742 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c389d11d-f1c5-4851-a750-a354fddebe51 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.259183 Oct 17 07:07:28.539762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 336/684] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:28 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:28.749209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:28.749982 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:28.758254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.758804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.759240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.760922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.761173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-b30343e6-1275-4a5e-9457-25ab6b30ee50 req-f270b4a1-0b75-48ef-b004-b22049bf50bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b7b9c4-3e52-48ef-b0d1-df7e70b76e57", "name": "network-vif-deleted", "tag": "24d2c2af-b02b-47ef-b2c3-b96aba9d5da6"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:28.761823 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.762608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.771990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-b30343e6-1275-4a5e-9457-25ab6b30ee50 req-f270b4a1-0b75-48ef-b004-b22049bf50bf service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.773017 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-b30343e6-1275-4a5e-9457-25ab6b30ee50 req-f270b4a1-0b75-48ef-b004-b22049bf50bf service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.773574 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-b30343e6-1275-4a5e-9457-25ab6b30ee50 req-f270b4a1-0b75-48ef-b004-b22049bf50bf service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.785809 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-b30343e6-1275-4a5e-9457-25ab6b30ee50 req-f270b4a1-0b75-48ef-b004-b22049bf50bf service nova] Creating event network-vif-deleted:24d2c2af-b02b-47ef-b2c3-b96aba9d5da6 for instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 on hv-cinder-84506 Oct 17 07:07:28.790268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-b30343e6-1275-4a5e-9457-25ab6b30ee50 req-f270b4a1-0b75-48ef-b004-b22049bf50bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Oct 17 07:07:28.791036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 337/685] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:07:28.838622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:28.847117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a3298f8f-33e9-445d-87cc-9af2d718e71a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1612 microversion: 2.1 time: 0.103302 Oct 17 07:07:28.847740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 349/686] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:28 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:28.955398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-a81e7d9e-e2a1-4109-93f6-8ec475ace7ed req-967ac15c-4610-47cf-895b-d73e56e0f032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ca5f24-f6d6-4847-a8b9-d6155ad652db", "name": "network-vif-deleted", "tag": "a2219ded-3614-41d2-ada2-7c5864d2d9f4"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:28.970442 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a81e7d9e-e2a1-4109-93f6-8ec475ace7ed req-967ac15c-4610-47cf-895b-d73e56e0f032 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:28.971009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a81e7d9e-e2a1-4109-93f6-8ec475ace7ed req-967ac15c-4610-47cf-895b-d73e56e0f032 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:28.971685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-a81e7d9e-e2a1-4109-93f6-8ec475ace7ed req-967ac15c-4610-47cf-895b-d73e56e0f032 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:28.984541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-a81e7d9e-e2a1-4109-93f6-8ec475ace7ed req-967ac15c-4610-47cf-895b-d73e56e0f032 service nova] Creating event network-vif-deleted:a2219ded-3614-41d2-ada2-7c5864d2d9f4 for instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db on hv-cinder-84506 Oct 17 07:07:28.990093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-a81e7d9e-e2a1-4109-93f6-8ec475ace7ed req-967ac15c-4610-47cf-895b-d73e56e0f032 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038748 Oct 17 07:07:28.990931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 338/687] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:29.301821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:29.302619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:29.310702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.311285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.311889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.312756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.313207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.313646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.335425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:29.336777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:29.344446 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.345398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.346049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.346945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.347642 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.348258 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.381763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.382508 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.382939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.383616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lazy-loading 'fault' on Instance uuid 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:29.446049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:29.454198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cb8a1674-06ec-415b-8f77-ec26c3b8f54f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 200 len: 1308 microversion: 2.1 time: 0.123854 Oct 17 07:07:29.454762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 339/688] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:29 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:29.482086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:29.490433 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bfd62338-5f49-4236-9399-f9a25fe190bf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.192403 Oct 17 07:07:29.491092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 350/689] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:29 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:29.562566 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:29.563173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:29.569466 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.569983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.570423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.571122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.571605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.572034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.706788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:29.716432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dc8e9179-2a83-4f7b-8f48-9c79d0b4c49e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.157763 Oct 17 07:07:29.718079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 340/690] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:29 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:29.870969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:29.871701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:29.878177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.878668 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.879108 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.879839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.880791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.881220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.918949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:29.919334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:29.919779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:29.920242 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lazy-loading 'fault' on Instance uuid e5ca5f24-f6d6-4847-a8b9-d6155ad652db {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:07:29.969657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:29.980194 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-23712834-d8b8-41d7-93e6-abe40fb8bb2c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 200 len: 1331 microversion: 2.1 time: 0.113038 Oct 17 07:07:29.980786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 351/691] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:29 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:30.477873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:30.478492 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:30.484862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:30.485337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:30.485766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:30.486478 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:30.486927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:30.487386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:30.500947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] HTTP exception thrown: Instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 could not be found. Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Request method failure captured: Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 HTTP/1.1 Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP7D8-hk0sl9KXgcqi2uY_ZWRptyGsje9-41KBilrKfKEYTloam0Zd8XqLKhG7P7nADKQ6vMLx25SxemM2v8okpVXP1Vld3Y9aWT8RkRtB26ZaTprIxFB-ieRMTc3ilR_I4Ky_L18cqWZ3ViSw03MMGct_iQKjbYJyKQ_XZnTR4O60o Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: a3f4b1d3bce74b54ac996990fb44d782 Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesSnapshotTestJSON-900607078 Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:07:30.502548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3f4b1d3bce74b54ac996990fb44d782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3f4b1d3bce74b54ac996990fb44d782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3f4b1d3bce74b54ac996990fb44d782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3f4b1d3bce74b54ac996990fb44d782"}]}] Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesSnapshotTestJSON-900607078 Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: a3f4b1d3bce74b54ac996990fb44d782 Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-900607078 Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesSnapshotTestJSON-900607078-project Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: e65cf0e0271d4dc8adcc2bbb5ad48fb8 Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesSnapshotTestJSON-900607078-project Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 could not be found. Oct 17 07:07:30.504122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '57b7b9c4-3e52-48ef-b0d1-df7e70b76e57'} Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 could not be found. Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:07:30.505035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 could not be found. Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 could not be found. Oct 17 07:07:30.506412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:07:30.507597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Returning 404 to user: Instance 57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:07:30.507597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-07e3f8ae-e4e5-4b04-b427-b104102a1cde tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57" status: 404 len: 111 microversion: 2.1 time: 0.030123 Oct 17 07:07:30.507597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 341/692] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:30 2022] GET /compute/v2.1/servers/57b7b9c4-3e52-48ef-b0d1-df7e70b76e57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:07:30.513981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:30.514616 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:30.520741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:30.521216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:30.521644 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:30.522320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:30.522769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:30.523752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:30.663392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:30.672032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1540c46f-b5e4-44a7-8690-4d04d6f6d887 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.162082 Oct 17 07:07:30.672610 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 352/693] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:30 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:30.743431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:30.744043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:30.750039 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:30.750563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:30.751004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:30.751720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:30.752173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:30.752598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:30.770603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:30.882366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:30.890053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d835d00d-31bd-4408-a431-c6f2212e7b3d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.150781 Oct 17 07:07:30.890613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 342/694] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:30 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:31.005117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:31.005721 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:31.012126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:31.012604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:31.013037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:31.013711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:31.014167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:31.014578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:31.028420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db HTTP/1.1 Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:07:31.030127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:07:31.031692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'e5ca5f24-f6d6-4847-a8b9-d6155ad652db'} Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:07:31.032594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:07:31.033985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:31.035523 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:07:31.035523 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2621a514-d1b6-42b6-8fcf-a7a1896ed318 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 404 len: 111 microversion: 2.1 time: 0.030269 Oct 17 07:07:31.035523 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 353/695] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:31 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:07:31.040087 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-df9cd067-47b1-4390-802e-b23830b72424 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '.version_select at 0x7f4accf51af0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:31.060070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-df9cd067-47b1-4390-802e-b23830b72424 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046883129" status: 202 len: 0 microversion: 2.1 time: 0.023687 Oct 17 07:07:31.060611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 343/696] 10.222.0.36 () {58 vars in 1221 bytes} [Mon Oct 17 07:07:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046883129 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:07:31.687168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-89ccba90-7cc4-4b50-9662-36948e94183f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: .version_select at 0x7f4acd2b8af0>, body: {"keypair": {"name": "tempest-keypair-71894821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfpn/cvxwO62RPT2UUK88Xh6wOM6ROd/tSp+KMfluOUiRRl6I9uwk4MvaIcj3U4EKMph06IKVSxwXHU5dz7YTvO2tiyHWwVpvh3ZiDCTZahi7rI+/O9X+69eol2hoxCWw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:31.696205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:31.696810 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:31.703699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:31.704196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:31.704329 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-89ccba90-7cc4-4b50-9662-36948e94183f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:07:31.704629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:31.705391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:31.705771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:31.706193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:31.708585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-89ccba90-7cc4-4b50-9662-36948e94183f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:07:31.732773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-89ccba90-7cc4-4b50-9662-36948e94183f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049470 Oct 17 07:07:31.733512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 354/697] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:07:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:07:31.846740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:31.856284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dfe4b653-9c86-4a67-8b2d-b7e7b98f8820 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.164373 Oct 17 07:07:31.856852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 344/698] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:31 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:31.913606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:31.914251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:31.920896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:31.921384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:31.921827 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:31.922515 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:31.922967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:31.923418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:32.088402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:32.092848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:32.097995 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d962f106-6cce-496f-8840-b5729dbf96db tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.188263 Oct 17 07:07:32.098782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 355/699] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:31 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:32.879293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:32.879904 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:32.885994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:32.886477 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:32.886916 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:32.887627 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:32.888076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:32.888499 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:33.021203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:33.029796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-97ffa22e-ac0c-48ca-ab05-9c70946e31ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.154281 Oct 17 07:07:33.030361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 345/700] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:32 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:33.043941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1898814850", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b"}], "security_groups": [{"name": "tempest-securitygroup--1382977674"}], "key_name": "tempest-keypair-71894821", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:33.121700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:33.122340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:33.128227 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:33.128781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:33.129217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:33.129905 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:33.130355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:33.130780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:33.148622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] validate_networks() for [('27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:07:33.339177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:33.346912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1713724e-aab8-46b9-9d7e-7fec338d0ba6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.229422 Oct 17 07:07:33.347513 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 346/701] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:33 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:33.584454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:07:33.584882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:07:33.585359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:07:33.585789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:07:33.586205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:07:33.595517 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:33.596000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:33.596437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:33.597167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:33.597625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:33.598048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:33.614319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:07:33.618262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:07:33.629357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:07:33.631692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:07:33.678563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e9ee7309-071f-410b-8a5b-8c9078a4a71b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.640177 Oct 17 07:07:33.679396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 356/702] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:07:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:07:33.690393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-113dbe76-faf7-4694-a997-d1d2535128c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:33.691010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-113dbe76-faf7-4694-a997-d1d2535128c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:33.744176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-113dbe76-faf7-4694-a997-d1d2535128c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:33.751565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-113dbe76-faf7-4694-a997-d1d2535128c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1240 microversion: 2.1 time: 0.064943 Oct 17 07:07:33.752130 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 347/703] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:33 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:34.054345 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:34.054957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:34.062408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:34.062896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:34.063360 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:34.064048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:34.064497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:34.064918 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:34.199767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:34.208718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f4de732c-f4c6-4a3f-9372-ff14747f5ffb tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.158605 Oct 17 07:07:34.209280 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 357/704] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:34 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:34.370602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:34.371328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:34.377929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:34.378402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:34.378828 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:34.379532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:34.379978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:34.380390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:34.512447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:34.520296 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0afbcd51-fb77-4ee2-87e8-1ca2014f5068 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.153757 Oct 17 07:07:34.520855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 348/705] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:34 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:34.773855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:34.774992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:34.781358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:34.781836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:34.782267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:34.782945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:34.783425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:34.783844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:34.846962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:34.855401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f6b623b8-f45e-4486-b6f7-bfcb9366981f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1292 microversion: 2.1 time: 0.085266 Oct 17 07:07:34.855968 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 358/706] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:34 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:35.233277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:35.233814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:35.240939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:35.241440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:35.241978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:35.242697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:35.243183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:35.243660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:35.378024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:35.387163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-42c1e5fd-0386-498a-afda-ddcf67da55c0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.158264 Oct 17 07:07:35.387950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 349/707] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:35 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:35.543162 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:35.543755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:35.550306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:35.550799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:35.551268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:35.551970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:35.552434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:35.552862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:35.879018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:35.880348 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:35.892752 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:35.894190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:35.894848 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:35.896189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:35.896905 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:35.897528 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:35.937782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:35.945920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d5f5e4ac-b5e7-426d-9ec6-2ad3d3f32b50 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.406616 Oct 17 07:07:35.946507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 359/708] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:35 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:35.970242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:35.978269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1715ba82-f411-46ff-bf9e-400aebffdd9a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1298 microversion: 2.1 time: 0.103507 Oct 17 07:07:35.978843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 350/709] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:35 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:36.411679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:36.412323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:36.418476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:36.418970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:36.419439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:36.420139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:36.420596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:36.421024 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:36.551537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:36.559958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-914e2bcd-1cc0-4462-8d85-a4574feaf943 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.152152 Oct 17 07:07:36.568629 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 360/710] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:36 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:36.962575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-85220e8a-5e1c-4778-bc61-4aed5f4ae998 req-88be5a3c-13ef-49d3-b681-2fe1a2400f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2bcdbd-c141-4c72-b7ac-60134fe19975", "tag": "6ac53546-0258-4f57-a4dd-37d115a68327"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:36.972113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:36.972724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:36.980528 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-85220e8a-5e1c-4778-bc61-4aed5f4ae998 req-88be5a3c-13ef-49d3-b681-2fe1a2400f0f service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:36.981251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-85220e8a-5e1c-4778-bc61-4aed5f4ae998 req-88be5a3c-13ef-49d3-b681-2fe1a2400f0f service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:36.981686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-85220e8a-5e1c-4778-bc61-4aed5f4ae998 req-88be5a3c-13ef-49d3-b681-2fe1a2400f0f service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:36.982233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:36.982727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:36.983165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:36.983932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:36.985265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:36.985890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:36.993239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-85220e8a-5e1c-4778-bc61-4aed5f4ae998 req-88be5a3c-13ef-49d3-b681-2fe1a2400f0f service nova] Creating event network-changed:6ac53546-0258-4f57-a4dd-37d115a68327 for instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 on hv-cinder-84506 Oct 17 07:07:36.998950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-85220e8a-5e1c-4778-bc61-4aed5f4ae998 req-88be5a3c-13ef-49d3-b681-2fe1a2400f0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040425 Oct 17 07:07:36.999579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 351/711] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:07:37.004643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:37.005340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:37.012007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:37.012491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:37.012920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:37.013617 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:37.014082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:37.014511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:37.181893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:37.189407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:37.190248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-235e3e08-da57-4c31-845b-dc9fb916aa64 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.221914 Oct 17 07:07:37.191144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 361/712] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:36 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:37.197438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f766c607-59ad-437a-86e4-11d0f6aaa53f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.196734 Oct 17 07:07:37.198037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 352/713] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:36 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:37.583999 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:37.584534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:37.590884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:37.591422 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:37.591851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:37.592530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:37.592982 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:37.593399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:37.723615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:37.731853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ff8c460d-2480-424a-bafb-63e545c253a6 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.151747 Oct 17 07:07:37.732416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 362/714] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:37 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:38.214042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:38.214656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:38.220252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:38.220863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:38.221307 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:38.221802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:38.222224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:38.222913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:38.223745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:38.224177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:38.226896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:38.227421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:38.227846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:38.228563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:38.229075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:38.230043 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:38.415072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:38.422826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:38.423472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6bbf0955-d2b7-4477-a5cb-51ea541b07d7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1676 microversion: 2.1 time: 0.214163 Oct 17 07:07:38.424044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 353/715] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:38 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:38.430594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7aba0a48-d7f5-4c5f-9326-575fc917a81b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.214134 Oct 17 07:07:38.431153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 363/716] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:38 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:38.755254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:38.755893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:38.761787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:38.762267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:38.762697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:38.763407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:38.763862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:38.764278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:38.896125 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:38.904837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cb79e34c-7bf9-4957-9e2a-ec55792a176a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.153508 Oct 17 07:07:38.905408 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 354/717] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:38 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:39.413789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-424691097", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "networks": [{"uuid": "141ad0c8-e75e-4ca2-a8bf-1ac4d8022b10"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:39.449328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:39.449930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:39.456840 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.457503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.458030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:39.458821 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.459404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.459818 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:39.472497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] validate_networks() for [('141ad0c8-e75e-4ca2-a8bf-1ac4d8022b10', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:07:39.673780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:39.684197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3a8c622c-f747-49e7-a718-c44da450b918 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1653 microversion: 2.1 time: 0.239318 Oct 17 07:07:39.685114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 355/718] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:39 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1653 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:39.690671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:39.692398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:39.700271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.701516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.702156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:39.703117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.703805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.704303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:39.931222 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:39.939911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-895800e2-28fa-47f6-acb1-220be4fb5605 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.253507 Oct 17 07:07:39.940636 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 356/719] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:39 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:39.945536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9052464e-037a-41d2-a297-c432305c6b0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:39.955285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9052464e-037a-41d2-a297-c432305c6b0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.956655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9052464e-037a-41d2-a297-c432305c6b0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.957327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9052464e-037a-41d2-a297-c432305c6b0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:39.981701 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9052464e-037a-41d2-a297-c432305c6b0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Going to try to start instance {{(pid=118996) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 07:07:39.983248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:07:39.983248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:07:39.983724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:07:39.984129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:07:39.984534 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:07:39.993325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.993905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.994564 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:39.995330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:39.995780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:39.996378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:40.014295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Getting quotas for project a3f4b1d3bce74b54ac996990fb44d782. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:07:40.018207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Getting quotas for user e65cf0e0271d4dc8adcc2bbb5ad48fb8 and project a3f4b1d3bce74b54ac996990fb44d782. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:07:40.027590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9052464e-037a-41d2-a297-c432305c6b0f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action" status: 202 len: 0 microversion: 2.1 time: 0.085411 Oct 17 07:07:40.031343 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 357/720] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:07:39 2022] POST /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:07:40.031512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:07:40.032912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:07:40.034808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:40.035697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:40.042750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:40.043606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:40.044185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:40.045146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:40.045640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:40.046083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:40.054898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:40.090154 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a60abd48-f678-447e-8de1-ba61fa248724 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680463 Oct 17 07:07:40.098467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 364/721] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:07:40.103782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:40.104939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:40.112779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:40.113150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:40.113577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:40.114272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:40.114704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:40.115121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:40.286506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:40.295666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8cde26f0-7d86-4a0b-b7f9-6f7461cdfc7f tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.265657 Oct 17 07:07:40.303985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 358/722] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:40 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:40.303985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-78c58529-df9f-4df5-afa9-678fbca8d356 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:40.303985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-78c58529-df9f-4df5-afa9-678fbca8d356 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:40.316224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:40.325897 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c3e460e5-a07d-414c-870d-b579aa108c97 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1662 microversion: 2.1 time: 0.225816 Oct 17 07:07:40.326683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 365/723] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:40 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:40.371761 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-78c58529-df9f-4df5-afa9-678fbca8d356 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:40.378711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-78c58529-df9f-4df5-afa9-678fbca8d356 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1218 microversion: 2.1 time: 0.081427 Oct 17 07:07:40.379313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 359/724] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:40 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:40.963696 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:40.964846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:40.971170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:40.971798 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:40.972230 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:40.972904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:40.973349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:40.973766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.101723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:41.109862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ec66363b-d0b6-4ed6-b018-0e85c6f4533f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.150051 Oct 17 07:07:41.110420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 366/725] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:40 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:41.321358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:41.322727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:41.330146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:41.330705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:41.331221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.332018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:41.332541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:41.333035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.351065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:41.352181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:41.360786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:41.362130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:41.362890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.365298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:41.366931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:41.367573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.552262 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:41.563248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:41.563515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-359136ff-d16d-4b7a-ab2d-5a2ab3111a25 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.247136 Oct 17 07:07:41.564502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 360/726] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:41 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:41.569645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:41.570871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:41.580903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:41.581413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:41.581875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.582833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:41.583928 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:41.584369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:41.585384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2cf7c8f0-6db0-4c07-ae35-d14932b9bafb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1662 microversion: 2.1 time: 0.238305 Oct 17 07:07:41.586174 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 367/727] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:41 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1662 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:41.649061 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:41.652520 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:41.657393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-58948178-ecbd-45e5-995f-f12beb3257b0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1270 microversion: 2.1 time: 0.091576 Oct 17 07:07:41.657962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 361/728] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:41 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:42.132129 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:42.132659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:42.139019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.139538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.139976 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.140691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.141145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.141568 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.268014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:42.276658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-94cbfc20-fd1c-4b01-98ed-14d193d7f8a7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.148432 Oct 17 07:07:42.277226 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 368/729] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:42 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:42.589966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:42.590587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:42.598189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.598834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.599308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.600050 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.600511 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.600935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.612263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:42.613010 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:42.620454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.621061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.621565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.622380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.622874 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.623402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.802305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:42.811568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-44ef89e3-6a10-4bc2-ae4f-4603a1df21c1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.226636 Oct 17 07:07:42.812342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 362/730] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:42 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:42.814592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:42.822804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fcf8652c-2e99-4fd8-8875-4e03bc3e8bfd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1662 microversion: 2.1 time: 0.216529 Oct 17 07:07:42.823615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 369/731] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:42 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1662 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:42.835726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:42.836348 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:42.843118 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.843635 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.844073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.844768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:42.845231 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:42.845651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:42.917003 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:42.929810 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-31f8d027-c520-4dd6-a2b6-73544385c344 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1276 microversion: 2.1 time: 0.105989 Oct 17 07:07:42.930726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 363/732] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:42 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:43.299304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:43.299937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:43.306446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:43.306927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:43.307395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:43.308678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:43.309130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:43.309552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:43.442813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:43.451385 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-50d0f67f-8842-4cc6-8e5e-80f18efcd323 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.156061 Oct 17 07:07:43.451946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 370/733] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:43 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:43.841163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:43.841163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:43.846450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:43.847320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:43.859769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:43.861031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:43.861528 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:43.862394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:43.862518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:43.862948 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:43.863840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:43.864635 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:43.865160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:43.865685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:43.866189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:43.866879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:44.097791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:44.101309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:44.106735 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-21f7f3a8-fb0c-44ff-a9eb-2be82ca768aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1666 microversion: 2.1 time: 0.263940 Oct 17 07:07:44.107167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 371/734] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:43 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1666 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:44.112136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:44.112684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:44.118355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:44.118838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:44.119368 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:44.120236 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:44.120802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:44.121407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:44.126532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b516a4be-e658-4746-9865-31235c01dee1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.291059 Oct 17 07:07:44.127233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 364/735] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:43 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:44.203306 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-196eb356-a985-4143-b667-5870d6c2171f req-1109df14-4bd1-431b-b1c4-25f816f04845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9d231e-5e43-479c-8c3a-7afd41c59a24", "tag": "f42ca9a9-fe1b-4d81-a69a-d0a66f0b2847"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:44.209994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:44.213989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-196eb356-a985-4143-b667-5870d6c2171f req-1109df14-4bd1-431b-b1c4-25f816f04845 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:44.215110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-196eb356-a985-4143-b667-5870d6c2171f req-1109df14-4bd1-431b-b1c4-25f816f04845 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:44.215628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-196eb356-a985-4143-b667-5870d6c2171f req-1109df14-4bd1-431b-b1c4-25f816f04845 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:44.229748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-196eb356-a985-4143-b667-5870d6c2171f req-1109df14-4bd1-431b-b1c4-25f816f04845 service nova] Creating event network-changed:f42ca9a9-fe1b-4d81-a69a-d0a66f0b2847 for instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 on hv-cinder-84506 Oct 17 07:07:44.235453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-196eb356-a985-4143-b667-5870d6c2171f req-1109df14-4bd1-431b-b1c4-25f816f04845 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036764 Oct 17 07:07:44.236624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 365/736] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:44.259445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:44.267595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4b6c8739-3d69-4836-95b9-9754a24e2d90 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.159259 Oct 17 07:07:44.268159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 372/737] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:44 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:44.474748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:44.475479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:44.481822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:44.482298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:44.482758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:44.483489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:44.483934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:44.484350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:44.611031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:44.618745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7a476b01-a60d-4ed1-9bfd-53f6dba9acfa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.148202 Oct 17 07:07:44.619396 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 366/738] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:44 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:45.149591 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:45.150204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:45.156760 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.157360 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.157673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.158358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.158809 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.159248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.290212 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:45.290817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:45.304685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:45.308962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:45.311797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.318490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f57cd35a-d083-4f1a-9d9f-18977849b326 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.172649 Oct 17 07:07:45.320733 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.321428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.322471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.323011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.323522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.331903 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 373/739] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:45 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:45.358115 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-a9edfcaf-2ee6-4343-9849-fb3975c66df6 req-75f243bb-08d0-4384-bed1-60fe1a99bf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2bcdbd-c141-4c72-b7ac-60134fe19975", "name": "network-vif-plugged", "status": "completed", "tag": "6ac53546-0258-4f57-a4dd-37d115a68327"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:45.368184 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a9edfcaf-2ee6-4343-9849-fb3975c66df6 req-75f243bb-08d0-4384-bed1-60fe1a99bf3d service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.368587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a9edfcaf-2ee6-4343-9849-fb3975c66df6 req-75f243bb-08d0-4384-bed1-60fe1a99bf3d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.369021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a9edfcaf-2ee6-4343-9849-fb3975c66df6 req-75f243bb-08d0-4384-bed1-60fe1a99bf3d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.383327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-a9edfcaf-2ee6-4343-9849-fb3975c66df6 req-75f243bb-08d0-4384-bed1-60fe1a99bf3d service nova] Creating event network-vif-plugged:6ac53546-0258-4f57-a4dd-37d115a68327 for instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 on hv-cinder-84506 Oct 17 07:07:45.388304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-a9edfcaf-2ee6-4343-9849-fb3975c66df6 req-75f243bb-08d0-4384-bed1-60fe1a99bf3d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034563 Oct 17 07:07:45.389180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 374/740] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:07:45.472578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:45.487852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-581b03ee-1186-4104-b3d1-d1c00fd48a29 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.201245 Oct 17 07:07:45.494225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 367/741] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:45 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:45.642664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:45.643318 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:45.649418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.649908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.650340 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.651031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:45.651513 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:45.652459 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:45.779279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:45.786847 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f286f868-1745-42e9-b68c-750ed7b7356a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.148513 Oct 17 07:07:45.787459 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 375/742] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:45 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:46.342748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:46.343299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:46.350028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:46.350504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:46.350932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:46.351634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:46.352086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:46.352502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:46.487250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:46.496834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3d050933-2798-4395-b47b-c3adafb3ba14 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1736 microversion: 2.1 time: 0.157997 Oct 17 07:07:46.497727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 368/743] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:46 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:46.511354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:46.511983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:46.518487 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:46.519081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:46.519560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:46.521031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:46.521504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:46.521936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:46.660652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:46.668261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cad68491-2418-4c13-b81a-a5864430ac42 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.161004 Oct 17 07:07:46.668816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 376/744] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:46 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:46.809407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:46.810017 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:46.815867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:46.816342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:46.816764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:46.817432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:46.817874 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:46.818286 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:46.946742 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:46.955050 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9c8cd6a4-a441-4743-a7bf-c87741ce78e0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.149753 Oct 17 07:07:46.955714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 369/745] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:46 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:47.519842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:47.520563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:47.527547 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.528040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.528485 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.529170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.529622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.530091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.660583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:47.669346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-28d976c3-9ef6-4a00-b1e3-5948fe773449 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1716 microversion: 2.1 time: 0.153425 Oct 17 07:07:47.669927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 377/746] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:47 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:47.689742 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:47.690425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:47.697103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.697589 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.698024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.698778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.699273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.699704 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.782578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:47.783072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:47.789317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.789805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.790227 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.790931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.791406 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.791826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.922429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] HTTP exception thrown: Cannot 'detach_volume' instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 while it is in vm_state rescued Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Request method failure captured: Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments/c599eefe-ad4b-46b0-ba46-2ef236422374 HTTP/1.1 Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4r7ZFOUxuecQz5SIb8HGYdw1dHJnbuuRuX9fTDDNFvYs4HGL4tY3ROExPHc_geC7Pmljq35QkMSJBT_0ep-YASoAmGRloynlaGRjBJzdCz2_mBMyPxmxcmAc2yW5UWS9kbocXA8DnDoT3tfZHbranKFVMWWamczrQ-0YndiwWOG-A Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:07:47.924051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0cb1aa55658342fcaf2f493f51e9faeb"}]}] Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: c987a5a52fc641f78054ac0218edcd13 Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:07:47.926401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Cannot 'detach_volume' instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 while it is in vm_state rescued Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'server_id': '42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1', 'id': 'c599eefe-ad4b-46b0-ba46-2ef236422374'} Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:07:47.927518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 while it is in vm_state rescued Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 while it is in vm_state rescued Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:07:47.929958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Returning 409 to user: Cannot 'detach_volume' instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 while it is in vm_state rescued {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:07:47.932256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0fb89833-2f3e-4f95-b386-031c49b73ebf tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments/c599eefe-ad4b-46b0-ba46-2ef236422374" status: 409 len: 152 microversion: 2.1 time: 0.146948 Oct 17 07:07:47.932256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 378/747] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:07:47 2022] DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments/c599eefe-ad4b-46b0-ba46-2ef236422374 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 07:07:47.935310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:47.935831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:47.942634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.943125 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.943585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.944275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:47.944723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:47.945141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:47.982117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:47.989594 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9e2f0b5c-aafb-4da5-9b22-076ffe9aad12 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.303739 Oct 17 07:07:47.990151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 370/748] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:47 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:47.994770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:47.995558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:48.001548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:48.002061 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:48.002485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:48.003163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:48.003633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:48.004047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:48.016507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9f8b79cf-fa7c-4732-9847-379c13a22e52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "POST /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.085281 Oct 17 07:07:48.017250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 379/749] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:07:47 2022] POST /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:07:48.025674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:48.026305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:48.032983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:48.033466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:48.033929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:48.034649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:48.035106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:48.035555 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:48.256400 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:48.264908 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-be42e9a4-97ef-4b4c-9efc-ad1db90108b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1366 microversion: 2.1 time: 0.273589 Oct 17 07:07:48.265707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 371/750] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:47 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:48.280647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:48.291152 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7d664c3a-e5b5-4019-a2f3-a20b1c240c75 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1724 microversion: 2.1 time: 0.269412 Oct 17 07:07:48.291755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 380/751] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:48 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:49.013054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:49.013698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:49.020515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.020997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.021424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.022100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.022548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.022965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.151894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:49.159753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-03472356-f343-4356-8393-8fca9528f2ef tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.150599 Oct 17 07:07:49.160311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 372/752] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:49 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:49.288861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:49.289396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:49.296063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.296593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.297158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.297837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.298285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.298778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.315198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:49.315822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:49.321684 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.322155 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.322578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.323284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.324371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.324785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.492073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:49.501241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cbc64401-c892-4a8a-9749-14c167fb5753 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1555 microversion: 2.1 time: 0.216318 Oct 17 07:07:49.501806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 381/753] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:49 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:49.501929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:49.510059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f53a0d37-565c-462a-98bf-d353da43e17b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1724 microversion: 2.1 time: 0.198622 Oct 17 07:07:49.510606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 373/754] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:49 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:07:49.523108 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:49.523625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:49.529997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.530474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.530905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.531609 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:49.532056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:49.532737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:49.608377 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-32087eeb-926b-4352-91ff-8ca772bff8ca tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088953 Oct 17 07:07:49.608956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 382/755] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:07:49 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:50.182225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:50.182846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:50.189239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:50.189721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:50.190148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:50.190831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:50.191314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:50.191733 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:50.377576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=4 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:50.423270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:50.431196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c384efd0-be66-4e5c-8a45-828cdb43cda4 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.252963 Oct 17 07:07:50.432037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 374/756] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:50 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:50.533698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:50.534913 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:50.536979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:50.537648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=16 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:50.544630 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:50.545117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:50.545571 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:50.546260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:50.546711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:50.547356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:50.596885 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-70231212-2871-47fe-93db-63735cb6135a req-de416e20-2bd0-4e95-a337-36e291684491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2bcdbd-c141-4c72-b7ac-60134fe19975", "tag": "6ac53546-0258-4f57-a4dd-37d115a68327"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:50.606667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-70231212-2871-47fe-93db-63735cb6135a req-de416e20-2bd0-4e95-a337-36e291684491 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:50.607152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-70231212-2871-47fe-93db-63735cb6135a req-de416e20-2bd0-4e95-a337-36e291684491 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:50.607611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-70231212-2871-47fe-93db-63735cb6135a req-de416e20-2bd0-4e95-a337-36e291684491 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:50.621215 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-70231212-2871-47fe-93db-63735cb6135a req-de416e20-2bd0-4e95-a337-36e291684491 service nova] Creating event network-changed:6ac53546-0258-4f57-a4dd-37d115a68327 for instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 on hv-cinder-84506 Oct 17 07:07:50.626404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-70231212-2871-47fe-93db-63735cb6135a req-de416e20-2bd0-4e95-a337-36e291684491 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033052 Oct 17 07:07:50.627601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 375/757] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:51.019890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:51.028929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3fb3a2ea-ab39-438b-9d12-4aaf36e2c1f1 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1724 microversion: 2.1 time: 0.499087 Oct 17 07:07:51.029585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 383/758] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:50 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:51.457036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:51.457842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:51.464170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:51.464658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:51.465091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:51.465790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:51.466242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:51.466662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:51.601696 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:51.610409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b174aa86-3aa4-4d13-82d9-09e37acef32c tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.158096 Oct 17 07:07:51.611053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 376/759] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:51 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:52.052299 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:52.052907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:52.059316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:52.059793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:52.060220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:52.060898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:52.061346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:52.061766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:52.194042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:52.203080 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4f82c8ea-d0cf-4575-838b-a628ffa55a52 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1724 microversion: 2.1 time: 0.154567 Oct 17 07:07:52.204118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 384/760] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:52 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:52.633333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:52.633943 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:52.640315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:52.640799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:52.641232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:52.641921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:52.642372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:52.642793 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:52.789154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:52.797275 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8f1f5593-5dd2-48f1-9aa6-4f3b827ee02e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.167838 Oct 17 07:07:52.797841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 377/761] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:52 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:53.226565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:53.227794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:53.234055 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:53.234535 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:53.234971 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:53.235690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:53.236146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:53.236566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:53.362229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:53.370412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-556d76a5-4199-4ccd-b1b9-117b94edce8b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1730 microversion: 2.1 time: 0.147671 Oct 17 07:07:53.370993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 385/762] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:53 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:53.393210 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:53.393784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:53.399775 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:53.400260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:53.400693 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:53.401405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:53.402438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:53.402871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:53.480659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b977cab0-2ee0-4a36-81ee-eec00ef0e3ae tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091344 Oct 17 07:07:53.481259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 378/763] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:07:53 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:53.820458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:53.821133 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:53.827792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:53.828274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:53.828701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:53.829405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:53.829853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:53.830271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:54.050547 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:54.061068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b7991fc1-4100-45b3-bf19-335ba125bf54 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.244392 Oct 17 07:07:54.061650 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 386/764] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:53 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:54.513101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-519dc66f-f5e2-4cc3-a6cc-cc6335502c9c req-6873ea76-a753-4a88-aa4c-30ff4ec1953b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1", "tag": "a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:54.523437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-519dc66f-f5e2-4cc3-a6cc-cc6335502c9c req-6873ea76-a753-4a88-aa4c-30ff4ec1953b service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:54.523919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-519dc66f-f5e2-4cc3-a6cc-cc6335502c9c req-6873ea76-a753-4a88-aa4c-30ff4ec1953b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:54.524347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-519dc66f-f5e2-4cc3-a6cc-cc6335502c9c req-6873ea76-a753-4a88-aa4c-30ff4ec1953b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:54.536855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-519dc66f-f5e2-4cc3-a6cc-cc6335502c9c req-6873ea76-a753-4a88-aa4c-30ff4ec1953b service nova] Creating event network-changed:a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0 for instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 on hv-cinder-84506 Oct 17 07:07:54.542753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-519dc66f-f5e2-4cc3-a6cc-cc6335502c9c req-6873ea76-a753-4a88-aa4c-30ff4ec1953b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033468 Oct 17 07:07:54.543424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 379/765] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:55.084203 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:55.084931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:55.092396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:55.092979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:55.093517 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:55.094445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:55.094982 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:55.095526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:55.228383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:55.237758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7abce8df-164c-4b27-bd8e-92e6b41b4352 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.157644 Oct 17 07:07:55.251386 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 387/766] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:55 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:55.462965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-16a09723-bc93-4b6b-8ffe-012094d68cf1 req-6995df27-a7c3-4e6a-b5d5-7a2c88422399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9d231e-5e43-479c-8c3a-7afd41c59a24", "name": "network-vif-plugged", "status": "completed", "tag": "f42ca9a9-fe1b-4d81-a69a-d0a66f0b2847"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:55.473030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-16a09723-bc93-4b6b-8ffe-012094d68cf1 req-6995df27-a7c3-4e6a-b5d5-7a2c88422399 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:55.473521 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-16a09723-bc93-4b6b-8ffe-012094d68cf1 req-6995df27-a7c3-4e6a-b5d5-7a2c88422399 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:55.473950 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-16a09723-bc93-4b6b-8ffe-012094d68cf1 req-6995df27-a7c3-4e6a-b5d5-7a2c88422399 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:55.487676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-16a09723-bc93-4b6b-8ffe-012094d68cf1 req-6995df27-a7c3-4e6a-b5d5-7a2c88422399 service nova] Creating event network-vif-plugged:f42ca9a9-fe1b-4d81-a69a-d0a66f0b2847 for instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 on hv-cinder-84506 Oct 17 07:07:55.492956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-16a09723-bc93-4b6b-8ffe-012094d68cf1 req-6995df27-a7c3-4e6a-b5d5-7a2c88422399 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034297 Oct 17 07:07:55.493558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 380/767] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:56.261384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:56.261985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:56.268495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:56.269073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:56.269550 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:56.270226 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:56.270674 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:56.271090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:56.398069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:56.406784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b52010ef-0863-4f35-bc36-83407cd5d404 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1318 microversion: 2.1 time: 0.149726 Oct 17 07:07:56.407382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 388/768] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:56 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:56.557196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-77aa2e23-5048-44e7-b41f-0e53b84fde82 req-3e8d7acf-3c9d-4b23-8aae-e526b7b7f592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1", "tag": "a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:56.567624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-77aa2e23-5048-44e7-b41f-0e53b84fde82 req-3e8d7acf-3c9d-4b23-8aae-e526b7b7f592 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:56.568091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-77aa2e23-5048-44e7-b41f-0e53b84fde82 req-3e8d7acf-3c9d-4b23-8aae-e526b7b7f592 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:56.568510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-77aa2e23-5048-44e7-b41f-0e53b84fde82 req-3e8d7acf-3c9d-4b23-8aae-e526b7b7f592 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:56.579237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-77aa2e23-5048-44e7-b41f-0e53b84fde82 req-3e8d7acf-3c9d-4b23-8aae-e526b7b7f592 service nova] Creating event network-changed:a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0 for instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 on hv-cinder-84506 Oct 17 07:07:56.583991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-77aa2e23-5048-44e7-b41f-0e53b84fde82 req-3e8d7acf-3c9d-4b23-8aae-e526b7b7f592 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Oct 17 07:07:56.584604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 381/769] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:07:57.429406 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:07:57.429944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:57.436883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:57.437370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:57.437806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:57.438497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:57.438954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:57.439416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:57.720417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:07:57.728206 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4ccf8aa0-032a-4929-b677-3bdeba50a878 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1507 microversion: 2.1 time: 0.302850 Oct 17 07:07:57.728764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 389/770] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:07:57 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:07:57.752513 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6993bb7c-a56e-42c2-ae73-de31f6167ecf", "device": "/dev/sdb"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:07:57.754995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:07:57.761110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:57.761590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:57.762020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:57.762704 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:07:57.763156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:07:57.763606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:07:57.767582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:07:58.172515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5ed1b2a7-d6fb-497b-8287-18c69e0d0e30 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "POST /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424680 Oct 17 07:07:58.173120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 382/771] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:07:57 2022] POST /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:00.722012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:00.722511 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:00.730106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:00.730593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:00.731030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:00.731753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:00.732207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:00.732632 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:00.749874 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:00.765230 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0b245c4f-2919-48a1-82fe-8fc78c995274 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments/6125aedd-7fec-4e35-89cc-48068444b022" status: 200 len: 194 microversion: 2.20 time: 0.047278 Oct 17 07:08:00.765802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 390/772] 10.222.0.36 () {60 vars in 1454 bytes} [Mon Oct 17 07:08:00 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments/6125aedd-7fec-4e35-89cc-48068444b022 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:00.834461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:00.835046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:00.841171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:00.841653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:00.842114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:00.842794 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:00.843278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:00.843701 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:00.922067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lazy-loading 'services' on Instance uuid 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:00.997081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-79f7c12f-32a7-4620-8548-3d4afcfe46fa tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments/6125aedd-7fec-4e35-89cc-48068444b022" status: 202 len: 0 microversion: 2.20 time: 0.167419 Oct 17 07:08:00.997662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 383/773] 10.222.0.36 () {60 vars in 1457 bytes} [Mon Oct 17 07:08:00 2022] DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments/6125aedd-7fec-4e35-89cc-48068444b022 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:08:01.006998 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:01.009665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:01.015794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:01.016322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:01.016845 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:01.017957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:01.018960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:01.019464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:01.052522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5b14957a-0be4-452d-a6ff-e9e32d2b6533 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050232 Oct 17 07:08:01.053439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 391/774] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:01 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:02.067071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:02.069422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:02.076481 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:02.076959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:02.077386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:02.078069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:02.078519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:02.078939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:02.106917 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e3e0d36e-2ffd-4b0b-8b86-229f89a45b5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044691 Oct 17 07:08:02.107484 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 384/775] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:02 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:03.119041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:03.121871 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:03.128210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:03.128682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:03.129107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:03.129782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:03.130227 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:03.130646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:03.159639 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-74e4d180-e490-491e-ad4b-dbdd743d0d37 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044457 Oct 17 07:08:03.160194 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 392/776] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:03 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:04.171970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:04.174134 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:04.180503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:04.180989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:04.181419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:04.182103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:04.183058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:04.183501 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:04.212690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-26f2895d-b8db-4a3d-be3e-8e866d96ff7c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044736 Oct 17 07:08:04.213233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 385/777] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:04 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:05.225766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:05.228034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:05.234759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:05.235278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:05.235722 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:05.236442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:05.236881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:05.237311 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:05.268545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e980d11c-490f-49b8-9f77-c7fb7205bfca tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046979 Oct 17 07:08:05.269089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 393/778] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:05 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:06.281680 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:06.283901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:06.290234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:06.290712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:06.291144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:06.291927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:06.292350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:06.292860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:06.321629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7d5850cf-005c-411c-b392-4d28d7cdb603 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043844 Oct 17 07:08:06.322107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 386/779] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:06 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:07.334171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:07.336341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:07.342684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:07.343161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:07.343621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:07.344298 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:07.344743 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:07.345159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:07.374008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ad3025df-8ecf-40e3-9a35-ec6bbb28aff1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043852 Oct 17 07:08:07.374545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 394/780] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:07 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:08.386692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:08.388886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:08.395238 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:08.395736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:08.396166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:08.396846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:08.397294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:08.397713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:08.426610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-64cd6fe3-8ebd-452c-b48d-39d19666005b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044446 Oct 17 07:08:08.427084 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 387/781] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:08 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:09.202326 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-677880669"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:09.202830 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:09.209257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:09.209736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:09.210166 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:09.210839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:09.211308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:09.211731 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:09.340095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.network.security_group_api [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Removing security group 7f90909c-50f6-468e-b1f8-9fee810f0132 from port c02e456f-4c7d-4e27-b8ff-de4e7755400c Oct 17 07:08:09.440056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:09.444694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:09.452247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:09.452994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:09.453665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:09.454704 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:09.455403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:09.456171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:09.488997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f3a4fceb-74d2-48c6-b8e1-2b65ff85f190 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053598 Oct 17 07:08:09.489625 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 388/782] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:09 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 07:08:09.658106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c8362328-79a8-461c-84be-25c8dbdee158 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.459956 Oct 17 07:08:09.658731 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 395/783] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:08:09 2022] POST /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:08:09.667675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-75a8e6b5-6ec8-4dc4-b2e6-8e578637071c req-d0b7447e-c253-4856-baff-c2bd7b4d1363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:09.677086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-75a8e6b5-6ec8-4dc4-b2e6-8e578637071c req-d0b7447e-c253-4856-baff-c2bd7b4d1363 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:09.677467 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-75a8e6b5-6ec8-4dc4-b2e6-8e578637071c req-d0b7447e-c253-4856-baff-c2bd7b4d1363 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:09.677834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-75a8e6b5-6ec8-4dc4-b2e6-8e578637071c req-d0b7447e-c253-4856-baff-c2bd7b4d1363 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:09.689911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-75a8e6b5-6ec8-4dc4-b2e6-8e578637071c req-d0b7447e-c253-4856-baff-c2bd7b4d1363 service nova] Creating event network-changed:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:08:09.697255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-75a8e6b5-6ec8-4dc4-b2e6-8e578637071c req-d0b7447e-c253-4856-baff-c2bd7b4d1363 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031280 Oct 17 07:08:09.699180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 389/784] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:08:10.502350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:10.504445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:10.506301 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=63 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:10.511793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:10.512284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:10.512716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:10.513409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:10.513861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:10.514287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:10.543626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c489a150-a17f-41b2-8575-c37b851ae248 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045828 Oct 17 07:08:10.544173 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 396/785] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:08:10 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:10.611399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:10.612166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:10.618566 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:10.619052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:10.619563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:10.620842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:10.621298 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:10.621715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:10.648735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:08:10.729536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3830d429-fb61-49d4-89a9-708e4f283a28 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 204 len: 0 microversion: 2.20 time: 0.122738 Oct 17 07:08:10.730316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 390/786] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 17 07:08:10 2022] DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 07:08:10.739286 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:10.740014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:10.747026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:10.747605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:10.748028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:10.748728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:10.749175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:10.749801 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:10.880882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:10.889714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:10.891137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:10.892402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d7ec1e8e-1d3c-4c0c-a8da-187debad4bb0 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.157681 Oct 17 07:08:10.892962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 397/787] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:10 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:11.021991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:11.022566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-8139fc2a-a6a9-4a40-8ac5-c27f47ff56eb req-f192c950-a57f-48db-b128-e7b59b5074c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:11.022712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:11.030088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.030947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.031553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:11.032332 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.032862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.033358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:11.033476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8139fc2a-a6a9-4a40-8ac5-c27f47ff56eb req-f192c950-a57f-48db-b128-e7b59b5074c2 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.034000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8139fc2a-a6a9-4a40-8ac5-c27f47ff56eb req-f192c950-a57f-48db-b128-e7b59b5074c2 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.034501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8139fc2a-a6a9-4a40-8ac5-c27f47ff56eb req-f192c950-a57f-48db-b128-e7b59b5074c2 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:11.046907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-8139fc2a-a6a9-4a40-8ac5-c27f47ff56eb req-f192c950-a57f-48db-b128-e7b59b5074c2 service nova] Creating event network-changed:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:08:11.065114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-8139fc2a-a6a9-4a40-8ac5-c27f47ff56eb req-f192c950-a57f-48db-b128-e7b59b5074c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046108 Oct 17 07:08:11.065832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 398/788] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:11.129686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lazy-loading 'services' on Instance uuid 37652e60-5928-4ba0-8d97-6c0932d0fdf9 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:11.218029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e21be3ef-6fb9-4f80-8391-32798296b04d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments/9b11779b-7c29-4608-911e-9c6f26a44231" status: 202 len: 0 microversion: 2.1 time: 0.200698 Oct 17 07:08:11.219367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 391/789] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:08:11 2022] DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments/9b11779b-7c29-4608-911e-9c6f26a44231 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:08:11.230256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:11.232888 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:11.240685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.241422 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.242650 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:11.243660 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.244403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.245201 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:11.277675 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a02f7310-cf63-497f-b631-e77d4774308a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053492 Oct 17 07:08:11.278401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 399/790] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:11 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:11.919652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:11.920434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:11.926774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.927548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.927913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:11.928843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:11.929316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:11.929794 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:12.060167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:12.068176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:12.069616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:12.070768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f73a2b62-c7f6-4b30-a820-dec43343d0a8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.156564 Oct 17 07:08:12.071344 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 392/791] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:11 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:12.289928 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:12.292945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:12.299366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:12.299851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:12.300286 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:12.300977 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:12.301434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:12.301860 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:12.334380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-38896151-dbe4-4ff5-84c6-9e33a129eb14 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048292 Oct 17 07:08:12.334937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 400/792] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:12 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:13.097366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:13.097971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:13.105184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:13.105659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:13.106086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:13.106759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:13.107201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:13.107639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:13.238872 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:13.247034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:13.248494 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:13.249629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-dff9a1dc-1d69-444d-9e3c-9f06805b6253 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.156170 Oct 17 07:08:13.250182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 393/793] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:13 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:13.347296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:13.349484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:13.356016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:13.356501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:13.356931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:13.357647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:13.358156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:13.358687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:13.392164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-934d0a69-e28d-4680-9b70-e4005a44bb0d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048837 Oct 17 07:08:13.397131 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 401/794] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:13 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:14.274978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:14.275603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:14.277995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:14.283057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:14.283563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:14.283999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:14.284670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:14.285113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:14.285525 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:14.405211 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:14.407699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:14.414600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:14.415089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:14.415578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:14.416807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:14.417266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:14.417690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:14.449628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c96216c5-b85f-4645-b3bc-3c4216651e6d tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048541 Oct 17 07:08:14.450218 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 402/795] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:14 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:08:14.661790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:14.669914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:14.671376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:14.672532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f4b2595d-2657-47ea-acfd-afce2cd1fce3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.401518 Oct 17 07:08:14.673092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 394/796] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:14 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:15.462058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:15.464376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:15.470695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:15.471223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:15.471647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:15.472348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:15.472807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:15.473235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:15.506020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-21f9add4-869e-4afd-bd87-bee0c56ac0ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Oct 17 07:08:15.506587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 403/797] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:15 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:15.698691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:15.700093 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:15.706970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:15.707588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:15.708327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:15.709275 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:15.710092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:15.710575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:15.715588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:15.855891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:15.864183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:15.865633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:15.866829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-14843cd9-51b2-425f-9b61-7cc7f53b227b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1722 microversion: 2.20 time: 0.172773 Oct 17 07:08:15.867428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 395/798] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:15 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:16.521944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:16.524227 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:16.545067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:16.545713 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:16.546253 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:16.547084 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:16.547765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:16.548297 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:16.592457 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9a997b1a-e2ce-4ba0-ad5a-f222292445de tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075583 Oct 17 07:08:16.598009 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 404/799] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:16 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:16.893695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:16.894415 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:16.903921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:16.904667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:16.905312 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:16.906016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:16.906634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:16.907273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.017931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:17.026858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:17.028328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:17.029492 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-54d2c99d-c6fc-40ca-af21-ed42b14efd53 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1655 microversion: 2.20 time: 0.140436 Oct 17 07:08:17.030053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 396/800] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:16 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:17.406265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-2cbf6a4c-2ce7-4631-95e2-b30bcb884214 req-251e3562-a6f3-4ecf-b4f6-3c755c3b85f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090d6db5-0067-4e80-90c6-ac2c9fb23ed1", "name": "network-vif-deleted", "tag": "2b9bb44b-a8d5-40f2-8a4a-e17a66772700"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:17.429038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2cbf6a4c-2ce7-4631-95e2-b30bcb884214 req-251e3562-a6f3-4ecf-b4f6-3c755c3b85f0 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.429606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2cbf6a4c-2ce7-4631-95e2-b30bcb884214 req-251e3562-a6f3-4ecf-b4f6-3c755c3b85f0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.430120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2cbf6a4c-2ce7-4631-95e2-b30bcb884214 req-251e3562-a6f3-4ecf-b4f6-3c755c3b85f0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.443398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-2cbf6a4c-2ce7-4631-95e2-b30bcb884214 req-251e3562-a6f3-4ecf-b4f6-3c755c3b85f0 service nova] Creating event network-vif-deleted:2b9bb44b-a8d5-40f2-8a4a-e17a66772700 for instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 on hv-cinder-84506 Oct 17 07:08:17.450911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-2cbf6a4c-2ce7-4631-95e2-b30bcb884214 req-251e3562-a6f3-4ecf-b4f6-3c755c3b85f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051110 Oct 17 07:08:17.451870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 405/801] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:17.606738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:17.609590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:17.612168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:08:17.612339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Mon Oct 17 07:08:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments (ip 10.222.0.36) !!! Oct 17 07:08:17.625328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.625821 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.626248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.626965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.627437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.628090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.676741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:17.678600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:17.686670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.687332 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.687774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.687891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f05c4511-076a-4b5d-a609-fe3491627717 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086487 Oct 17 07:08:17.688456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 397/802] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:17 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:08:17.688611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.694183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.694623 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.699245 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:17.700080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:17.706629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.707115 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.707758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.708458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:17.709181 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:17.709900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:17.792145 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] HTTP exception thrown: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 is not attached to volume 9b11779b-7c29-4608-911e-9c6f26a44231 Oct 17 07:08:17.793873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lazy-loading 'services' on Instance uuid 0f9d231e-5e43-479c-8c3a-7afd41c59a24 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Request method failure captured: Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments/9b11779b-7c29-4608-911e-9c6f26a44231 HTTP/1.1 Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP6UMlm4ahJcC3jU2J0GSL-oXR9A0YKEcdGRqAYvoZ10z7yajrlY1dwMGOwxK9Eamh5FD4048i5gv_FLNTKAN8kuPdkEcvbg8k7pxZDKVantXqnl4B-0VApkokkTNWTQpsqlueiVUPJBOGhWH4JH_a_cvYnlIdwQchqA9bZHaDZWGhY Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: db8098f6f78c49fa843d34d69b002daa Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-TestMinimumBasicScenario-279968367 Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:08:17.801971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/db8098f6f78c49fa843d34d69b002daa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db8098f6f78c49fa843d34d69b002daa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db8098f6f78c49fa843d34d69b002daa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_db8098f6f78c49fa843d34d69b002daa"}]}] Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-TestMinimumBasicScenario-279968367 Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: db8098f6f78c49fa843d34d69b002daa Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-TestMinimumBasicScenario-279968367 Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-TestMinimumBasicScenario-279968367-project Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: c09a31533d7847fea61682ff032f838b Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-TestMinimumBasicScenario-279968367-project Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:08:17.803652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 is not attached to volume 9b11779b-7c29-4608-911e-9c6f26a44231 Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'server_id': '37652e60-5928-4ba0-8d97-6c0932d0fdf9', 'id': '9b11779b-7c29-4608-911e-9c6f26a44231'} Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9b11779b-7c29-4608-911e-9c6f26a44231. Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:08:17.804553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 is not attached to volume 9b11779b-7c29-4608-911e-9c6f26a44231 Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 is not attached to volume 9b11779b-7c29-4608-911e-9c6f26a44231 Oct 17 07:08:17.806023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:08:17.808517 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Returning 404 to user: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 is not attached to volume 9b11779b-7c29-4608-911e-9c6f26a44231 {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:08:17.809546 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-618c9b66-0d64-401c-a0aa-ea3cf156310a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments/9b11779b-7c29-4608-911e-9c6f26a44231" status: 404 len: 154 microversion: 2.1 time: 0.114726 Oct 17 07:08:17.810409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 398/803] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:08:17 2022] DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9/os-volume_attachments/9b11779b-7c29-4608-911e-9c6f26a44231 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:08:17.927761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-258b0889-33c0-4722-b5ed-ef6af88f2d6a tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24/os-volume_attachments/6993bb7c-a56e-42c2-ae73-de31f6167ecf" status: 202 len: 0 microversion: 2.1 time: 0.258112 Oct 17 07:08:17.932862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 406/804] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:08:17 2022] DELETE /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24/os-volume_attachments/6993bb7c-a56e-42c2-ae73-de31f6167ecf => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:08:18.056056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:18.056804 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:18.067441 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:18.067936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:18.068665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:18.069538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:18.070159 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:18.071068 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:18.107397 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:18.108222 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:18.108812 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:18.109372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lazy-loading 'fault' on Instance uuid 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:18.153198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:18.163161 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:18.164765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:18.166066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-73420c64-2c54-433e-8e3e-43fad44c1809 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 200 len: 1371 microversion: 2.20 time: 0.114215 Oct 17 07:08:18.166670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 399/805] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:18 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:19.005908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:19.006520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:19.013592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:19.014690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:19.015140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:19.015870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:19.016331 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:19.016758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:19.042339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:08:19.056140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:19.116256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a1b1d4ea-54a7-4810-bb07-ea871ce5b268 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 204 len: 0 microversion: 2.1 time: 0.115843 Oct 17 07:08:19.117005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 407/806] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:08:18 2022] DELETE /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:08:19.125570 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:19.126171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:19.132607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:19.133080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:19.133504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:19.134185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:19.134640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:19.135690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:19.192580 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:19.193425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:19.200030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:19.200870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:19.201373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:19.202066 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:19.202521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:19.202973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:19.217602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] HTTP exception thrown: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Request method failure captured: Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 HTTP/1.1 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP6CRCZy5P8IXH__Lkagc-zFQhdhumibMflLdPlyH8VSB19o9r-B7MfouFVFPeReZKMhv3GlHt8hMPvpCH8ARZTOfvGxY9H3JENdmNqv0ZcaNBNpfyyjMxdo3XgyG95jv7U1CgfYL04ZZr3KsIvZanw7JdF8zMbhQPFWByyYB3-aVxc Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:08:19.219401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/721190b4f16142749dda7253941be2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_721190b4f16142749dda7253941be2c3"}]}] Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d404b2974f64aa8a6c32adfc3f7b0bc Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:08:19.221092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '090d6db5-0067-4e80-90c6-ac2c9fb23ed1'} Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:08:19.222208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:08:19.223701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:19.225104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Returning 404 to user: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:08:19.225104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-43ebbc41-927d-4641-8d03-12f26b9d1dcc tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 404 len: 111 microversion: 2.20 time: 0.032382 Oct 17 07:08:19.225104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 408/807] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:19 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 07:08:19.231430 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b0188885-a220-4916-97e0-c829a0dbcfc3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '.version_select at 0x7f4acd22f8b0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:19.252897 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b0188885-a220-4916-97e0-c829a0dbcfc3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377408679" status: 204 len: 0 microversion: 2.20 time: 0.025233 Oct 17 07:08:19.257108 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 409/808] 10.222.0.36 () {60 vars in 1259 bytes} [Mon Oct 17 07:08:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377408679 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 07:08:19.273436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:19.281922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4e97407a-1687-4143-a7bd-1927132dc8e6 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1553 microversion: 2.1 time: 0.160094 Oct 17 07:08:19.282496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 400/809] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:19 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:19.861853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5ddfcd7e-b37e-4bf8-b728-0e47242cac6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'create', calling method: .version_select at 0x7f4acd148790>, body: {"keypair": {"name": "tempest-keypair-43976790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBUqsEs1XM8JHGEx9m/+9JGCgCBCHpK8ms31/GoePK7XBp0uB9ZAIiILxJMpz4ZH/gv2s4sAXWbmM6qGw6GcFXWR4lMoEghzOIkUiy2e98ZB4cbOtpl0XL9ivjUOSs6Pw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:19.877900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-5ddfcd7e-b37e-4bf8-b728-0e47242cac6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for project 721190b4f16142749dda7253941be2c3. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:08:19.881624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-5ddfcd7e-b37e-4bf8-b728-0e47242cac6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for user 8d404b2974f64aa8a6c32adfc3f7b0bc and project 721190b4f16142749dda7253941be2c3. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:08:19.903673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5ddfcd7e-b37e-4bf8-b728-0e47242cac6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.045773 Oct 17 07:08:19.904254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 410/810] 10.222.0.36 () {62 vars in 1200 bytes} [Mon Oct 17 07:08:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 07:08:20.132223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:20.132743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:20.139706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:20.140197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:20.140630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:20.141294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:20.141737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:20.142149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:20.171927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:08:20.250699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6953f4b6-55c4-42bc-b2b5-7bf6a4f378c0 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 204 len: 0 microversion: 2.1 time: 0.122157 Oct 17 07:08:20.251285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 401/811] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:08:20 2022] DELETE /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:08:20.260933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:20.261642 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:20.268244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:20.268723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:20.269284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:20.269962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:20.270417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:20.270832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:20.305622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:20.306423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:20.313156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:20.313646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:20.314111 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:20.314834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:20.315311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:20.315733 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:20.557617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:20.567249 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3d62f285-7c5e-4f79-b861-2ecfe576a340 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1559 microversion: 2.1 time: 0.311601 Oct 17 07:08:20.567825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 411/812] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:20 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1559 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:20.603128 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:20.611652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-12023b7a-febc-4b69-9279-b3f90e7a2b0a tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1553 microversion: 2.1 time: 0.310876 Oct 17 07:08:20.612426 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 402/813] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:20 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:21.346127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-633225054", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0692302f-3838-4656-8053-3d467d585a8b"}], "security_groups": [{"name": "tempest-securitygroup--35272248"}], "key_name": "tempest-keypair-43976790", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:21.446617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] validate_networks() for [('0692302f-3838-4656-8053-3d467d585a8b', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:08:21.590702 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:21.591535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:21.598434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:21.598935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:21.599386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:21.600080 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:21.600538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:21.600954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:21.784655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:21.792427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fefddc0d-51c1-4414-b9e5-3746bf2a0e41 tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1513 microversion: 2.1 time: 0.206309 Oct 17 07:08:21.793002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 403/814] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:21 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:21.797460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:21.798059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:21.804587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:21.805178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:21.805787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:21.806478 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:21.807156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:21.807606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:22.192554 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:08:22.192999 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:08:22.193468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:08:22.193870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:08:22.194276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:08:22.203718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:22.204197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:22.204627 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:22.205351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:22.205803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:22.206232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:22.218979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:22.222449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for project 721190b4f16142749dda7253941be2c3. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:08:22.226475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Getting quotas for user 8d404b2974f64aa8a6c32adfc3f7b0bc and project 721190b4f16142749dda7253941be2c3. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:08:22.226837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-580b2957-890b-45a4-bd30-319bb17fa8ab tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1553 microversion: 2.1 time: 0.432854 Oct 17 07:08:22.227425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 404/815] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:21 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1553 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:22.237961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:08:22.240339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:08:22.287518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c781ac0a-4bdf-4f0e-82e3-7321f3516d18 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.945503 Oct 17 07:08:22.288162 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 412/816] 10.222.0.36 () {62 vars in 1188 bytes} [Mon Oct 17 07:08:21 2022] POST /compute/v2.1/servers => generated 400 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 07:08:22.300990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9cd30785-77cd-458d-bf1f-cc9e1eb13d90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:22.301597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9cd30785-77cd-458d-bf1f-cc9e1eb13d90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:22.355611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9cd30785-77cd-458d-bf1f-cc9e1eb13d90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:22.363028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9cd30785-77cd-458d-bf1f-cc9e1eb13d90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:22.364540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9cd30785-77cd-458d-bf1f-cc9e1eb13d90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:22.365671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9cd30785-77cd-458d-bf1f-cc9e1eb13d90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1279 microversion: 2.20 time: 0.068518 Oct 17 07:08:22.366217 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 405/817] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:22 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1279 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:22.816654 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:22.817265 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:22.824284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:22.824762 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:22.825189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:22.826121 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:22.826567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:22.826988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:22.956152 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:22.964397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5192af5f-8758-408d-bcba-5fd51639b0bc tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1513 microversion: 2.1 time: 0.151878 Oct 17 07:08:22.964957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 413/818] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:22 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:23.250091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:23.250699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:23.257069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:23.257549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:23.257977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:23.258654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:23.259100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:23.259544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:23.386221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:23.390963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:23.391608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:23.394110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fec7eb81-2b23-4490-86b3-04e8d0dad1b3 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1553 microversion: 2.1 time: 0.147872 Oct 17 07:08:23.394670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 406/819] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:23 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:23.397618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:23.398106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:23.398561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:23.399268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:23.399730 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:23.400157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:23.459560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:23.467491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:23.468936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:23.470086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fe12aa05-d5db-4a11-a547-e5a5323eb9ab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1283 microversion: 2.20 time: 0.082961 Oct 17 07:08:23.470664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 414/820] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:23 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1283 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:23.989027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:23.989833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:23.996670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:23.997361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:23.997791 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:23.998658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:23.999314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:23.999890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:24.256101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:24.264744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-365cb4c7-8a3e-4b8c-be1d-d27d31d6fc5e tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1513 microversion: 2.1 time: 0.279499 Oct 17 07:08:24.265313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 407/821] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:23 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:24.395967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-bff9289c-770b-4616-987b-5670cebc2c66 req-63a05907-fe0e-412b-bde4-ff36bf2d4521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37652e60-5928-4ba0-8d97-6c0932d0fdf9", "name": "network-vif-deleted", "tag": "c02e456f-4c7d-4e27-b8ff-de4e7755400c"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:24.407276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bff9289c-770b-4616-987b-5670cebc2c66 req-63a05907-fe0e-412b-bde4-ff36bf2d4521 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:24.407992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bff9289c-770b-4616-987b-5670cebc2c66 req-63a05907-fe0e-412b-bde4-ff36bf2d4521 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:24.408611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bff9289c-770b-4616-987b-5670cebc2c66 req-63a05907-fe0e-412b-bde4-ff36bf2d4521 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:24.419655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:24.420317 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:24.438805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-bff9289c-770b-4616-987b-5670cebc2c66 req-63a05907-fe0e-412b-bde4-ff36bf2d4521 service nova] Creating event network-vif-deleted:c02e456f-4c7d-4e27-b8ff-de4e7755400c for instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 on hv-cinder-84506 Oct 17 07:08:24.443657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:24.444435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:24.444591 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-bff9289c-770b-4616-987b-5670cebc2c66 req-63a05907-fe0e-412b-bde4-ff36bf2d4521 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052320 Oct 17 07:08:24.445183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:24.445404 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 415/822] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:24.448078 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:24.448745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:24.449187 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:24.497910 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:24.498878 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:24.506281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:24.507048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:24.507696 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:24.508589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:24.509215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:24.509831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:24.573753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09a31533d7847fea61682ff032f838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8098f6f78c49fa843d34d69b002daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:24.585586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cf70828c-7e08-4ee5-8130-0362647698ce tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 200 len: 1342 microversion: 2.1 time: 0.170563 Oct 17 07:08:24.591815 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:24.602883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 408/823] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:24 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:24.611520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:24.613283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:24.614641 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a3046e40-c4ee-43a5-bb8f-8a581b090144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1339 microversion: 2.20 time: 0.122134 Oct 17 07:08:24.615953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 416/824] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:24 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:25.288202 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:25.288810 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:25.295191 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.295762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.296190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.296874 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.297321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.297738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.328567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.329049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.329507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.331065 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lazy-loading 'fault' on Instance uuid 0f9d231e-5e43-479c-8c3a-7afd41c59a24 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:25.404221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65cf0e0271d4dc8adcc2bbb5ad48fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f4b1d3bce74b54ac996990fb44d782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:25.411941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0a5d5f89-71d9-4bbe-aa3c-a5c74116fb9f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 200 len: 1308 microversion: 2.1 time: 0.128074 Oct 17 07:08:25.412661 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 409/825] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:25 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:25.608865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:25.609758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] [instance: 37652e60-5928-4ba0-8d97-6c0932d0fdf9] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:25.616303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.616854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.617568 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.618267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.618721 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.619172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.633457 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] HTTP exception thrown: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 could not be found. Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Request method failure captured: Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 HTTP/1.1 Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP6UMlm4ahJcC3jU2J0GSL-oXR9A0YKEcdGRqAYvoZ10z7yajrlY1dwMGOwxK9Eamh5FD4048i5gv_FLNTKAN8kuPdkEcvbg8k7pxZDKVantXqnl4B-0VApkokkTNWTQpsqlueiVUPJBOGhWH4JH_a_cvYnlIdwQchqA9bZHaDZWGhY Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: db8098f6f78c49fa843d34d69b002daa Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestMinimumBasicScenario-279968367 Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:08:25.635769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/db8098f6f78c49fa843d34d69b002daa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db8098f6f78c49fa843d34d69b002daa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db8098f6f78c49fa843d34d69b002daa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_db8098f6f78c49fa843d34d69b002daa"}]}] Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestMinimumBasicScenario-279968367 Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: db8098f6f78c49fa843d34d69b002daa Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestMinimumBasicScenario-279968367 Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-TestMinimumBasicScenario-279968367-project Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: c09a31533d7847fea61682ff032f838b Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestMinimumBasicScenario-279968367-project Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 could not be found. Oct 17 07:08:25.637109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '37652e60-5928-4ba0-8d97-6c0932d0fdf9'} Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 could not be found. Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:08:25.637835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 could not be found. Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 could not be found. Oct 17 07:08:25.639058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:25.640211 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Returning 404 to user: Instance 37652e60-5928-4ba0-8d97-6c0932d0fdf9 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:08:25.641629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:25.642244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:25.645998 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e527227e-aaf5-4158-8247-30965c0d9055 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9" status: 404 len: 111 microversion: 2.1 time: 0.041251 Oct 17 07:08:25.646613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 417/826] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:25 2022] GET /compute/v2.1/servers/37652e60-5928-4ba0-8d97-6c0932d0fdf9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:08:25.651627 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.652395 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.653982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.654896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:25.657254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:25.657694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:25.663616 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5f762f9a-35dd-4657-adc7-63d79882b456 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] Calling method '.version_select at 0x7f4acd2b85e0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:25.686098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:25.705026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5f762f9a-35dd-4657-adc7-63d79882b456 tempest-TestMinimumBasicScenario-279968367 tempest-TestMinimumBasicScenario-279968367-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-327178294" status: 202 len: 0 microversion: 2.1 time: 0.053409 Oct 17 07:08:25.705590 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 418/827] 10.222.0.36 () {58 vars in 1269 bytes} [Mon Oct 17 07:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-327178294 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:08:25.911643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:25.923026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:25.924894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:25.926303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-abb01443-5872-48e8-891e-84a97da976d2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.288373 Oct 17 07:08:25.926921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 410/828] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:25 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:26.436656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:26.437556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] [instance: 0f9d231e-5e43-479c-8c3a-7afd41c59a24] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:26.444901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:26.445388 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:26.446023 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:26.446728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:26.447886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:26.448475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:26.462557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] HTTP exception thrown: Instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 could not be found. Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Request method failure captured: Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 HTTP/1.1 Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP7D8-hk0sl9KXgcqi2uY_ZWRptyGsje9-41KBilrKfKEYTloam0Zd8XqLKhG7P7nADKQ6vMLx25SxemM2v8okpVXP1Vld3Y9aWT8RkRtB26ZaTprIxFB-ieRMTc3ilR_I4Ky_L18cqWZ3ViSw03MMGct_iQKjbYJyKQ_XZnTR4O60o Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: a3f4b1d3bce74b54ac996990fb44d782 Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesSnapshotTestJSON-900607078 Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:08:26.464791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3f4b1d3bce74b54ac996990fb44d782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3f4b1d3bce74b54ac996990fb44d782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3f4b1d3bce74b54ac996990fb44d782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3f4b1d3bce74b54ac996990fb44d782"}]}] Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesSnapshotTestJSON-900607078 Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: a3f4b1d3bce74b54ac996990fb44d782 Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-900607078 Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesSnapshotTestJSON-900607078-project Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: e65cf0e0271d4dc8adcc2bbb5ad48fb8 Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesSnapshotTestJSON-900607078-project Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 could not be found. Oct 17 07:08:26.466577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '0f9d231e-5e43-479c-8c3a-7afd41c59a24'} Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 could not be found. Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:08:26.467510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 could not be found. Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 could not be found. Oct 17 07:08:26.469056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:26.470360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9d231e-5e43-479c-8c3a-7afd41c59a24", "name": "network-vif-deleted", "tag": "f42ca9a9-fe1b-4d81-a69a-d0a66f0b2847"}, {"name": "network-changed", "server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:26.471592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] Returning 404 to user: Instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:08:26.472621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-73ac6708-a5f6-4aea-886b-35cbb59ae95f tempest-VolumesSnapshotTestJSON-900607078 tempest-VolumesSnapshotTestJSON-900607078-project] 10.222.0.36 "GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24" status: 404 len: 111 microversion: 2.1 time: 0.040181 Oct 17 07:08:26.473656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 419/829] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:26 2022] GET /compute/v2.1/servers/0f9d231e-5e43-479c-8c3a-7afd41c59a24 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:08:26.481122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:26.481884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:26.482555 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:26.501196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] Creating event network-vif-deleted:f42ca9a9-fe1b-4d81-a69a-d0a66f0b2847 for instance 0f9d231e-5e43-479c-8c3a-7afd41c59a24 on hv-cinder-84506 Oct 17 07:08:26.501750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] Creating event network-changed:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:08:26.510075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-9aedef55-eba9-41cb-9f0f-1ab124f719f6 req-d250a26d-3d16-4668-92a7-9ad82f877ffd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048052 Oct 17 07:08:26.512832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 411/830] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:26.953722 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:26.954263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:26.961472 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:26.961958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:26.962432 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:26.963196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:26.963676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:26.964090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:27.095769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:27.105347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:27.106795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:27.107961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-142b4442-6aac-4554-bc2a-8970b9b508e6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.158690 Oct 17 07:08:27.108511 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 420/831] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:26 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:28.136076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:28.136803 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:28.154223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:28.154782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:28.155266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:28.155999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:28.156462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:28.156893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:28.395743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:28.409860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:28.412703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:28.416293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-04d6ce24-8388-4d8c-afe6-c97ace6fcf56 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.286012 Oct 17 07:08:28.421716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 412/832] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:28 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:29.443260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:29.443934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:29.453199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:29.453694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:29.454127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:29.454833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:29.455310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:29.455734 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:29.614939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:29.627794 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:29.629240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:29.630362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6adf0596-5d60-47b2-84be-8f70ca682c08 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.192294 Oct 17 07:08:29.630918 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 421/833] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:29 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:30.656486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:30.657101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:30.663455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:30.663941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:30.664380 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:30.665067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:30.665522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:30.665940 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:30.936361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:30.946017 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:30.948317 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:30.949423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5f1ae8dc-0a2b-477a-8fd6-9b3601229bf4 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.296963 Oct 17 07:08:30.950285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 413/834] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:30 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:31.975239 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:31.980225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:31.987542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:31.988028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:31.988464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:31.989168 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:31.989619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:31.990216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:32.213618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:32.233763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=10 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:32.241224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:32.250764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:32.252636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:32.253853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-90fb2999-cad2-4dc0-a406-00b51c187c17 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.282547 Oct 17 07:08:32.254813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 422/835] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:31 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:33.280056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:33.280597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:33.283113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:33.288781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:33.289270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:33.290733 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:33.291476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:33.291939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:33.292593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:33.429288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:33.444138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:33.446470 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:33.448308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5fa8f84f-9250-44f2-8601-b2b02226c97a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.172847 Oct 17 07:08:33.449436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 414/836] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:33 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:34.332469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6790f06e-2a82-4505-8d72-70bac1dd4dec req-ef5af0cf-9b9a-43c2-886a-a0b60d52e5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "name": "network-vif-plugged", "status": "completed", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:34.342775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6790f06e-2a82-4505-8d72-70bac1dd4dec req-ef5af0cf-9b9a-43c2-886a-a0b60d52e5d2 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:34.343488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6790f06e-2a82-4505-8d72-70bac1dd4dec req-ef5af0cf-9b9a-43c2-886a-a0b60d52e5d2 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:34.344047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6790f06e-2a82-4505-8d72-70bac1dd4dec req-ef5af0cf-9b9a-43c2-886a-a0b60d52e5d2 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:34.355297 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6790f06e-2a82-4505-8d72-70bac1dd4dec req-ef5af0cf-9b9a-43c2-886a-a0b60d52e5d2 service nova] Creating event network-vif-plugged:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:08:34.360641 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6790f06e-2a82-4505-8d72-70bac1dd4dec req-ef5af0cf-9b9a-43c2-886a-a0b60d52e5d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033491 Oct 17 07:08:34.361225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 423/837] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:34.474599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:34.475300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:34.482524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:34.483012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:34.483468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:34.484158 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:34.484608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:34.485026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:34.675149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:34.684518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:34.687167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:34.688931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-96d86c17-af48-4160-a620-4260da340c03 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.218757 Oct 17 07:08:34.689711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 415/838] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:34 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:35.576026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:35.578267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:35.584429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.584911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.585342 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.586023 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.586471 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.586895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.615421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c9cc66c3-24a8-4b44-88fc-550bd59f49cf tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045135 Oct 17 07:08:35.615953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 424/839] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:35 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:08:35.678577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:35.679058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:35.685928 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.686405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.686832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.687534 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.688029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.688447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.714565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:08:35.716072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:35.716693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:35.722505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.722989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.723469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.724211 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.724673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.725100 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.791313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-def00146-1c2f-4cfe-8848-f1fd3c566cbb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 204 len: 0 microversion: 2.1 time: 0.116792 Oct 17 07:08:35.791905 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 416/840] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:08:35 2022] DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:08:35.800346 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:35.801051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:35.808014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.808502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.808932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.809978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:35.810125 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:35.810629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:35.869586 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:35.877890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:35.879357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:35.880455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-de408607-4d6d-45d8-9259-e6130df03c6f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.168265 Oct 17 07:08:35.881341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 425/841] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:35 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:35.956723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:35.964370 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-24b2324c-68b2-40a4-ab02-d007fddf71df tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1672 microversion: 2.1 time: 0.168065 Oct 17 07:08:35.964929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 417/842] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:35 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:36.907006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:36.907705 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:36.913985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:36.914460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:36.914887 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:36.916085 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:36.916626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:36.917047 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:36.989083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:36.989688 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:36.997048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:36.997545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:36.997987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:36.998687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:36.999152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:36.999610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:37.071867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:37.080087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:37.081520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:37.082610 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2c01e9d8-80ea-43de-9d9e-442bcdef0e26 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.179490 Oct 17 07:08:37.083160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 426/843] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:36 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:37.134929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:37.142504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7d8cd42d-da07-4167-ba5f-105758223622 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1672 microversion: 2.1 time: 0.157405 Oct 17 07:08:37.143067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 418/844] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:36 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:38.108080 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:38.108711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:38.115079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:38.115587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:38.116015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:38.116691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:38.117137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:38.117553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:38.255127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:38.264389 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:38.265944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:38.266937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4c5672a3-4469-4632-87f4-fc9a315d4efb tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.162707 Oct 17 07:08:38.267530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 427/845] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:38 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:38.271936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:38.272530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:38.274702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:38.280213 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:38.280698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:38.281142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:38.281874 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:38.282339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:38.282758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:38.293614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:38.294117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:38.300210 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:38.300777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:38.301324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:38.302184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:38.302651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:38.303082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:38.327280 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5ab5d7be-3a7b-4bd6-8241-496349dadfa8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/ips" status: 200 len: 149 microversion: 2.1 time: 0.204688 Oct 17 07:08:38.327768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 419/846] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:08:38 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/ips => generated 149 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:08:38.413799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:38.422821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f1175875-2318-4f8f-9912-8844d60b414d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1672 microversion: 2.1 time: 0.154322 Oct 17 07:08:38.423682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 428/847] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:38 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:39.292235 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:39.292845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:39.299228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:39.299774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:39.300127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:39.300805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:39.301259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:39.301679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:39.434660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:39.443012 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:39.444517 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:39.445624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9f7f2d61-5b55-4157-b646-b45489dd34e1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.157844 Oct 17 07:08:39.445751 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:39.459196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:39.460099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 420/848] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:39 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:08:39.460200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:39.460200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:39.460200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:39.460200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:39.460522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:39.460522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:39.587842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:39.595544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9e82818d-a586-44b3-9b3e-3c053c1deb77 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1672 microversion: 2.1 time: 0.153559 Oct 17 07:08:39.611396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 429/849] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:39 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:39.666409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf4e0214-3805-4805-9da8-48e3b3360a4a"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:39.668843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:39.675128 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:39.675640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:39.676074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:39.676759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:39.677205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:39.677624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:40.472778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:40.473382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:40.480445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:40.480923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:40.481352 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:40.482028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:40.482475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:40.482894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:40.486805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:40.614465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:40.622468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:40.623926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:40.625016 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f35746ed-a502-467e-82de-30055f11c9e9 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1403 microversion: 2.20 time: 0.156220 Oct 17 07:08:40.625572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 430/850] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:40 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:40.629848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:40.630446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:40.636281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:40.636764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:40.637191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:40.637865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:40.638313 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:40.638727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:40.766605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:40.774719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a75e865c-a7be-4bf1-9fad-d46b249aca2d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1672 microversion: 2.1 time: 0.148154 Oct 17 07:08:40.775849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 431/851] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:40 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:41.651293 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:41.651916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:41.662611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:41.663102 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:41.663576 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:41.666835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:41.667473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:41.668004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:41.795991 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f17c76d6-c00d-4c96-a349-e805fd1ac770 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.133173 Oct 17 07:08:41.799390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 421/852] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:08:39 2022] POST /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments => generated 194 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:41.806614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:41.810120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:41.817747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:41.818379 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:41.818914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:41.819786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:41.820345 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:41.820898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:41.960254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:41.969815 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:41.971481 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:41.972620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a83e099b-ad14-4bf7-b158-b1c90da3ddd3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1594 microversion: 2.20 time: 0.325933 Oct 17 07:08:41.987409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 432/853] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:08:41 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1594 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:08:41.997234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:41.998033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:42.004554 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:42.005716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:42.006309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:42.007170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:42.007656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:42.008074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:42.095709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:42.104682 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-45d7d6c5-f3ad-4d50-970d-7c1a5ef48036 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1672 microversion: 2.1 time: 0.303675 Oct 17 07:08:42.107299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 422/854] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:41 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1672 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:42.127401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c0339e1e-a2d5-4619-ab67-a93543d98015 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.134027 Oct 17 07:08:42.128098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 433/855] 10.222.0.36 () {60 vars in 1316 bytes} [Mon Oct 17 07:08:41 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:08:43.102790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-29e78ea6-618e-44cc-86c3-029fddd28248 req-745f20e1-a61f-42be-9204-dac30eb19ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69682426-13b0-4029-8721-6832e661201a", "name": "network-vif-deleted", "tag": "58de9da1-c7e0-445c-861b-008ae64f8e05"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:43.113537 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-29e78ea6-618e-44cc-86c3-029fddd28248 req-745f20e1-a61f-42be-9204-dac30eb19ce5 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:43.114014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-29e78ea6-618e-44cc-86c3-029fddd28248 req-745f20e1-a61f-42be-9204-dac30eb19ce5 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:43.123820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-29e78ea6-618e-44cc-86c3-029fddd28248 req-745f20e1-a61f-42be-9204-dac30eb19ce5 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:43.135960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:43.136415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:43.146387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-29e78ea6-618e-44cc-86c3-029fddd28248 req-745f20e1-a61f-42be-9204-dac30eb19ce5 service nova] Creating event network-vif-deleted:58de9da1-c7e0-445c-861b-008ae64f8e05 for instance 69682426-13b0-4029-8721-6832e661201a on hv-cinder-84506 Oct 17 07:08:43.160731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-29e78ea6-618e-44cc-86c3-029fddd28248 req-745f20e1-a61f-42be-9204-dac30eb19ce5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130034 Oct 17 07:08:43.162519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:43.163086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:43.166556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:43.167545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:43.168034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:43.168505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:43.168637 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 423/856] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:08:43.269752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:43.271566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:43.272845 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:43.273902 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lazy-loading 'fault' on Instance uuid 69682426-13b0-4029-8721-6832e661201a {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:43.326617 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-e08c1858-29a2-4cd1-bbbe-d649d5f44e7b req-db55ffbe-8981-4b35-9d64-24797593d31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:43.343880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e08c1858-29a2-4cd1-bbbe-d649d5f44e7b req-db55ffbe-8981-4b35-9d64-24797593d31e service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:43.344945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e08c1858-29a2-4cd1-bbbe-d649d5f44e7b req-db55ffbe-8981-4b35-9d64-24797593d31e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:43.345639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e08c1858-29a2-4cd1-bbbe-d649d5f44e7b req-db55ffbe-8981-4b35-9d64-24797593d31e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:43.346451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:43.361408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04fd72ae-0064-4d52-a47e-1b1d4cc4b7aa tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 200 len: 1326 microversion: 2.1 time: 0.230981 Oct 17 07:08:43.362722 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 434/857] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:43 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 1326 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:43.380007 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-e08c1858-29a2-4cd1-bbbe-d649d5f44e7b req-db55ffbe-8981-4b35-9d64-24797593d31e service nova] Creating event network-changed:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:08:43.387250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-e08c1858-29a2-4cd1-bbbe-d649d5f44e7b req-db55ffbe-8981-4b35-9d64-24797593d31e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181902 Oct 17 07:08:43.391682 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 424/858] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:44.384859 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:44.385473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:44.392317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:44.392804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:44.393237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:44.394019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:44.394621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:44.395050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:44.408430 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] HTTP exception thrown: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Request method failure captured: Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a HTTP/1.1 Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4v6duY-JjrZHZbxsxLgB31jbTd9mxoms6wfxl0_GttHJ8QCB_2g9-e_75Vk33c6zdnwFhvk7KHijRS-1PB0FygJKzYAu3szN0G8NJm0Jb6ihb3lMTUz9wCUoUhrmhaH3tjuJZ9k2XSLuwTKUP3HNR65jewDyyhpHsWX4Gis0uwXBc Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:08:44.410057 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f992a8ccca8d487abd91dc6d0baaf3bc"}]}] Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 51b2f292cea24a21928e2adcef0c3786 Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:08:44.411772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '69682426-13b0-4029-8721-6832e661201a'} Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:08:44.412678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:08:44.414241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:44.416885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Returning 404 to user: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:08:44.416885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9e283cf1-582c-4241-80a0-b2dfb0949377 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 404 len: 111 microversion: 2.1 time: 0.030559 Oct 17 07:08:44.416885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 435/859] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:44 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:08:44.421957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5e688297-b087-486d-ae80-90cf3b7dd360 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '.version_select at 0x7f4acd052f70>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:44.429743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:44.447398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5e688297-b087-486d-ae80-90cf3b7dd360 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24946740" status: 202 len: 0 microversion: 2.1 time: 0.028102 Oct 17 07:08:44.447398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 425/860] 10.222.0.36 () {58 vars in 1215 bytes} [Mon Oct 17 07:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24946740 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:08:45.097965 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b596400d-6a63-4840-8eb9-3c66c18ccc69 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: .version_select at 0x7f4acd0d5d30>, body: {"keypair": {"name": "tempest-keypair-456951943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyFg8ikjXhclIjr3XQPfxq8LoE4X2BTc/Emj7yFiLf+1z2d9RKZbnmnimPrlGfigrjbJZYpv27s4Hmpey8JplGkTFs+zidjyBUq1/nH+won8kUua1GZFuyX8RHsMis7mQ=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:45.113957 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-b596400d-6a63-4840-8eb9-3c66c18ccc69 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:08:45.118058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-b596400d-6a63-4840-8eb9-3c66c18ccc69 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for user 51b2f292cea24a21928e2adcef0c3786 and project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:08:45.138251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:45.139027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:45.140237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b596400d-6a63-4840-8eb9-3c66c18ccc69 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047213 Oct 17 07:08:45.140824 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 436/861] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:08:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:45.149042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:45.150311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:45.150862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:45.151609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:45.152070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:45.152495 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:45.241075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lazy-loading 'services' on Instance uuid 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:45.305865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:45.317856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-40f43195-1d2a-4c89-bcfb-75565c3405ea tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments/c599eefe-ad4b-46b0-ba46-2ef236422374" status: 202 len: 0 microversion: 2.1 time: 0.184259 Oct 17 07:08:45.318527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 426/862] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:08:45 2022] DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments/c599eefe-ad4b-46b0-ba46-2ef236422374 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:08:45.327987 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:45.330306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:45.338170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:45.338869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:45.339530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:45.340378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:45.341004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:45.341450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:45.371597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6c8d8e8c-2ac3-4ea7-8cc3-575c4c5407d9 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047844 Oct 17 07:08:45.372144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 437/863] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:45 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:46.386211 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:46.388493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:46.395077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:46.395522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:46.395954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:46.396639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:46.397089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:46.397514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:46.400414 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1196609406", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4bf4f92-bc76-44e2-bbd3-6f7efc91b1a7"}], "security_groups": [{"name": "tempest-securitygroup--1709523108"}], "key_name": "tempest-keypair-456951943", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:46.427727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9190a9da-5953-42e9-819f-e69edeb9cc22 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047425 Oct 17 07:08:46.428286 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 427/864] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:46 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:46.507698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] validate_networks() for [('c4bf4f92-bc76-44e2-bbd3-6f7efc91b1a7', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:08:46.875348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:08:46.875767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:08:46.876600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:08:46.877005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:08:46.877412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:08:46.886839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:46.887352 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:46.887814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:46.888541 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:46.889209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:46.889667 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:46.906923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:08:46.911043 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Getting quotas for user 51b2f292cea24a21928e2adcef0c3786 and project f992a8ccca8d487abd91dc6d0baaf3bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:08:46.923405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:08:46.925745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:08:46.973391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-87cef1b2-073e-4be0-9ead-6e8ef3b561bc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577244 Oct 17 07:08:46.974023 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 438/865] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:08:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 07:08:46.985004 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ee3b2760-f885-45f4-ae13-2e580b38e6b3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:46.985611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ee3b2760-f885-45f4-ae13-2e580b38e6b3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:47.043138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ee3b2760-f885-45f4-ae13-2e580b38e6b3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:47.049917 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ee3b2760-f885-45f4-ae13-2e580b38e6b3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1237 microversion: 2.1 time: 0.068808 Oct 17 07:08:47.050483 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 428/866] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:46 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:47.441748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:47.444303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:47.451662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:47.452150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:47.452726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:47.453420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:47.453873 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:47.454293 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:47.487686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-157f101f-6349-4257-ab5e-9a7667df7bd0 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051214 Oct 17 07:08:47.488249 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 439/867] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:47 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:48.073827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:48.074523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:48.083113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:48.083639 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:48.084034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:48.084891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:48.085508 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:48.086082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:48.151836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:48.159785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a7bb0b4e-4e4a-48b1-b039-cb125e4e2944 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1289 microversion: 2.1 time: 0.090322 Oct 17 07:08:48.160382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 429/868] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:48 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:48.500666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:48.502783 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:48.509545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:48.510031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:48.510467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:48.511159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:48.511647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:48.512068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:48.540799 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a64ab539-be29-48da-b34a-428ecb861084 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Oct 17 07:08:48.541359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 440/869] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:48 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:49.182195 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:49.182799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:49.189223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.189707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.190137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.190819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.191288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.191706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.261855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:49.269616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8388160f-7d4c-412e-817f-c9e738997af8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1295 microversion: 2.1 time: 0.091583 Oct 17 07:08:49.270271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 430/870] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:49 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:49.450660 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf4e0214-3805-4805-9da8-48e3b3360a4a"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:49.453153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:49.459256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.459778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.460221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.460925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.461614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.462621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.553681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:49.556916 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:49.558034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Invalid volume: volume cf4e0214-3805-4805-9da8-48e3b3360a4a is already attached to instances: 6c2bcdbd-c141-4c72-b7ac-60134fe19975 Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments HTTP/1.1 Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 74 Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:08:49.560237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {"volumeAttachment": {"volumeId": "cf4e0214-3805-4805-9da8-48e3b3360a4a"}} Oct 17 07:08:49.561604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Invalid volume: volume cf4e0214-3805-4805-9da8-48e3b3360a4a is already attached to instances: 6c2bcdbd-c141-4c72-b7ac-60134fe19975 Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'server_id': '6c2bcdbd-c141-4c72-b7ac-60134fe19975', 'body': {'volumeAttachment': {'volumeId': 'cf4e0214-3805-4805-9da8-48e3b3360a4a'}}} Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf4e0214-3805-4805-9da8-48e3b3360a4a is already attached to instances: 6c2bcdbd-c141-4c72-b7ac-60134fe19975 Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:49.562399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf4e0214-3805-4805-9da8-48e3b3360a4a is already attached to instances: 6c2bcdbd-c141-4c72-b7ac-60134fe19975 Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:08:49.563601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:08:49.564800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:08:49.564800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:08:49.564800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:08:49.564800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf4e0214-3805-4805-9da8-48e3b3360a4a is already attached to instances: 6c2bcdbd-c141-4c72-b7ac-60134fe19975 Oct 17 07:08:49.564800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:08:49.565107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.565107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.565107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.565107 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.565417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.565498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.567089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 400 to user: Invalid volume: volume cf4e0214-3805-4805-9da8-48e3b3360a4a is already attached to instances: 6c2bcdbd-c141-4c72-b7ac-60134fe19975 {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:08:49.568225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f86d19fb-6eb2-4732-aac7-5bb9292239b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122654 Oct 17 07:08:49.569326 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 441/871] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:08:49 2022] POST /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:08:49.601049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f6e3e5eb-5b4f-4656-9e27-60b9f8df53ca tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051411 Oct 17 07:08:49.601594 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 431/872] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:49 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:08:49.652513 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:49.653275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:49.661504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.661933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.662363 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.663059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.663543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.663961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.765692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lazy-loading 'services' on Instance uuid 6c2bcdbd-c141-4c72-b7ac-60134fe19975 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:08:49.858615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9cb895b2-6f46-40f5-8729-1a32795f7598 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments/cf4e0214-3805-4805-9da8-48e3b3360a4a" status: 202 len: 0 microversion: 2.1 time: 0.210969 Oct 17 07:08:49.860192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 442/873] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:08:49 2022] DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments/cf4e0214-3805-4805-9da8-48e3b3360a4a => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 07:08:49.868722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:49.872362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:49.882475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.883540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.885223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.886713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:49.887473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:49.888221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:49.930279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-025d5cfb-a71d-468f-b54f-2af8470fdd7b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066277 Oct 17 07:08:49.931605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 432/874] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:49 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:08:50.294770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:50.295511 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:50.302662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.303458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.304075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.304828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.305288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.305779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.521976 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:50.533520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2c797b67-fd9d-4512-9ea8-b056f17784f2 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.244088 Oct 17 07:08:50.534426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 443/875] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:50 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:50.614111 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:50.616598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:50.624054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.624545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.625350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.626732 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.627487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.627925 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.660303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c2a6a9a4-5a37-4104-8086-1a94e997ae4b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050146 Oct 17 07:08:50.660951 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 433/876] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:50 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:08:50.744223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:50.744772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:50.752127 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.752835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.753454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.754455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.754913 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.755515 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.784461 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:08:50.886591 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7b347550-2e84-44ab-af16-56c7e67cf3a2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 204 len: 0 microversion: 2.1 time: 0.147113 Oct 17 07:08:50.887747 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 444/877] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:08:50 2022] DELETE /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:08:50.897846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:50.899137 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:50.908586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.909332 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.910491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.911514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.912830 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.913422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.944927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:50.948242 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:50.955339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.956149 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.957099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.958151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:50.958820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:50.959451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:50.993866 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9d582559-f1a4-4435-a758-29a3d5ec3c2f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052443 Oct 17 07:08:50.994822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 445/878] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:08:50 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:08:51.068544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:51.069116 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:51.075120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.075967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.076469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.077235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.077777 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.078275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.106579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:08:51.111013 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:51.163687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:51.174567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-eea95bcf-862d-4631-a1a1-94324a1a60b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.281631 Oct 17 07:08:51.175168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 434/879] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:50 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:51.208975 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-07a9e8e9-6ff7-44a2-a0f3-7684f96ce256 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 204 len: 0 microversion: 2.1 time: 0.143740 Oct 17 07:08:51.213276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 446/880] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:08:51 2022] DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:08:51.219737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:51.220435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:51.227610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.228199 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.228856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.229777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.230300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.231391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.283387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-84fe1c60-d363-479d-99dc-5931a67be589 req-e7304eca-963b-428a-95b5-fe727855c0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cad347-b818-4dc8-b9ab-26e38b5edf8e", "tag": "822458de-2d1e-4246-a342-8e13c6f3ed71"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:08:51.295542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-84fe1c60-d363-479d-99dc-5931a67be589 req-e7304eca-963b-428a-95b5-fe727855c0d0 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.296021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-84fe1c60-d363-479d-99dc-5931a67be589 req-e7304eca-963b-428a-95b5-fe727855c0d0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.296444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-84fe1c60-d363-479d-99dc-5931a67be589 req-e7304eca-963b-428a-95b5-fe727855c0d0 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.308106 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-84fe1c60-d363-479d-99dc-5931a67be589 req-e7304eca-963b-428a-95b5-fe727855c0d0 service nova] Creating event network-changed:822458de-2d1e-4246-a342-8e13c6f3ed71 for instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e on hv-cinder-84506 Oct 17 07:08:51.313263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-84fe1c60-d363-479d-99dc-5931a67be589 req-e7304eca-963b-428a-95b5-fe727855c0d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034974 Oct 17 07:08:51.313960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 447/881] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:08:51.410473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:51.418897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c38431d4-25a2-4a8e-82d2-a15b3a8562b8 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.204099 Oct 17 07:08:51.419768 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 435/882] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:51 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:51.557697 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:51.558407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:51.564828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.565317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.565754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.566451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:51.566920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:51.567379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:51.715996 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:51.723518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c7e9362a-746a-4f1b-8db6-597cb2456abc tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.171512 Oct 17 07:08:51.724027 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 448/883] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:51 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:52.201736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:52.202358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:52.208861 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:52.209350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:52.209787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:52.210474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:52.210930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:52.211384 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:52.341424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:52.349049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-62c2f104-879f-4daa-8eca-725cacd416ac tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.151472 Oct 17 07:08:52.349608 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 436/884] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:52 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:52.442912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:52.443566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:52.450207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:52.450941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:52.451404 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:52.452083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:52.452556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:52.452964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:52.579379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:52.587656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-732891c5-0e1a-40e5-8ec5-c40ed5482857 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.147827 Oct 17 07:08:52.588219 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 449/885] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:52 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:52.745859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:52.746496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:52.752367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:52.753030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:52.753462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:52.754154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:52.754605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:52.755028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:52.887647 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:52.895322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-408a39b1-88f7-46ff-be4f-39269a9990a8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.153242 Oct 17 07:08:52.895896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 437/886] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:52 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:53.373418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:53.374025 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:53.380011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:53.380488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:53.380915 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:53.381629 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:53.382078 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:53.382493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:53.510403 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:53.517996 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-74cc9d45-8965-46f6-9fff-3815f5cd8aa8 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.148535 Oct 17 07:08:53.518544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 450/887] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:53 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:53.609819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:53.610435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:53.616884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:53.617371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:53.617806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:53.618524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:53.618980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:53.619434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:53.744878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:53.752607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ca4572de-b619-4dcf-b529-222cbd91ff8c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.146657 Oct 17 07:08:53.753178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 438/888] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:53 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:53.917914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:53.918560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:53.925032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:53.925510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:53.925944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:53.926657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:53.927139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:53.927593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:54.059111 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:54.066726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0331a8c8-d2ba-4ca0-a16a-e835d330f794 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.153189 Oct 17 07:08:54.067296 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 451/889] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:53 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:54.541526 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:54.542152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:54.548086 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:54.548572 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:54.549000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:54.549687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:54.550136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:54.550558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:54.675461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:54.683078 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5be332f9-4b0b-4d58-947a-9e2de4c0d06c tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.146084 Oct 17 07:08:54.683671 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 439/890] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:54 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:54.776186 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:54.776796 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:54.782814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:54.783334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:54.783772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:54.784501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:54.784961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:54.785538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:54.913948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:54.921521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6a4db762-c5ce-4926-8fd3-c3378c8919be tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.149713 Oct 17 07:08:54.922077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 452/891] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:54 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:55.091032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:55.091591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:55.097469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:55.097936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:55.098371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:55.099053 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:55.099536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:55.099959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:55.227874 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:55.235906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c9a0bf46-5f4b-4cf5-82a1-bdf9f532ee00 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.149009 Oct 17 07:08:55.236469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 440/892] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:55 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:55.707095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:55.707729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:55.714136 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:55.714614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:55.715041 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:55.715746 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:55.716199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:55.716621 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:55.844675 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:55.860240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eaf5008b-a34e-4425-bb47-78f16e68a040 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.156636 Oct 17 07:08:55.861275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 453/893] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:55 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:55.947354 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:55.947961 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:55.954716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:55.955236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:55.955998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:55.956683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:55.957190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:55.957730 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:56.095113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:56.104150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5a821b8b-91ed-4088-bd90-d7704f6c9869 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.160636 Oct 17 07:08:56.104746 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 441/894] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:55 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:56.257960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:56.258518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:56.264936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:56.265417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:56.265848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:56.266531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:56.266970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:56.267416 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:56.391494 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:56.399151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-65306b7c-5b93-4c76-9c1a-a08985844e52 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.145124 Oct 17 07:08:56.400392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 454/895] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:56 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:56.885193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:56.885831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:56.891829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:56.892316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:56.892755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:56.893448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:56.893903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:56.894330 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:57.047930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:57.128848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:57.129692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:57.132309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:57.133157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=10 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:57.139177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:57.139664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:57.140108 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:57.140824 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:57.141282 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:57.141708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:57.326462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:57.330707 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:57.334600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2b378b56-8f83-49c3-a0fa-155056f8f25a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.453809 Oct 17 07:08:57.335185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 442/896] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:56 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:57.339991 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1c0fe3ba-c49e-4ac2-9114-9b103bc61501 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.215047 Oct 17 07:08:57.340624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 455/897] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:57 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:08:57.422358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:57.422975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:57.428996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:57.429481 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:57.429912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:57.430598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:57.431081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:57.431533 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:57.558013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:57.565720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a18dab09-b374-4b86-8682-3d2bcb734810 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.147207 Oct 17 07:08:57.566283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 443/898] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:57 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:58.358744 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:58.359309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:58.363908 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:58.364551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:58.365766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:58.366245 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:58.366676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:58.367387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:58.367842 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:58.368260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:58.371539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:58.372029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:58.372464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:58.373179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:58.373633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:58.374112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:58.392591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:58.557112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:58.561261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:58.565082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8ba24b35-be36-4a9a-8ffd-be18db389838 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.210288 Oct 17 07:08:58.565646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 456/899] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:58 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:58.569154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d64bd371-25b3-4606-899d-8bc11f05e75a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.209090 Oct 17 07:08:58.569708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 444/900] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:58 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:58.588073 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:58.588689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:58.594460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:58.594951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:58.595426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:58.596126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:58.596585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:58.597013 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:58.720979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:58.729038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bff93edc-d2c2-410d-b1af-e2873b39a73e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.144643 Oct 17 07:08:58.729594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 457/901] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:58 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:08:59.588449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:59.588960 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:59.591907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:08:59.592609 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:08:59.595620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:08:59.595824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:59.596313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:59.597077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:59.597936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:59.598473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:59.598943 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:59.600847 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:59.601366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:59.601807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:59.602510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:08:59.602967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:08:59.603428 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:08:59.983493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:59.985999 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:08:59.996067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-942d12ae-d16f-4e46-94c2-6be74bf94019 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1680 microversion: 2.1 time: 0.408355 Oct 17 07:08:59.996651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 458/902] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:59 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1680 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:00.006579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:00.007325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:00.007740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-549d7adb-7fcb-432a-a55d-161ece17298b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1690 microversion: 2.1 time: 0.421710 Oct 17 07:09:00.019599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:00.019599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:00.019599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:00.019599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:00.019898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:00.019898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:00.025089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 445/903] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:59 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1690 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:00.379014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:00.396250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e9536f44-1a56-4ac4-920f-0f420dcd9a3c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.398486 Oct 17 07:09:00.397486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 459/904] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:08:59 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:00.911764 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-c23b98ba-c685-4446-9fd2-d0f15fc45975 req-7fd228f8-4516-4322-95bd-66067c77f584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2bcdbd-c141-4c72-b7ac-60134fe19975", "name": "network-vif-deleted", "tag": "6ac53546-0258-4f57-a4dd-37d115a68327"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:00.922079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c23b98ba-c685-4446-9fd2-d0f15fc45975 req-7fd228f8-4516-4322-95bd-66067c77f584 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:00.922644 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c23b98ba-c685-4446-9fd2-d0f15fc45975 req-7fd228f8-4516-4322-95bd-66067c77f584 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:00.923140 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c23b98ba-c685-4446-9fd2-d0f15fc45975 req-7fd228f8-4516-4322-95bd-66067c77f584 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:00.935652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-c23b98ba-c685-4446-9fd2-d0f15fc45975 req-7fd228f8-4516-4322-95bd-66067c77f584 service nova] Creating event network-vif-deleted:6ac53546-0258-4f57-a4dd-37d115a68327 for instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 on hv-cinder-84506 Oct 17 07:09:00.941283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-c23b98ba-c685-4446-9fd2-d0f15fc45975 req-7fd228f8-4516-4322-95bd-66067c77f584 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033065 Oct 17 07:09:00.942097 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 446/905] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:01.021105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:01.021716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:01.028889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.029381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.029808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.030633 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.031097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.031553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.040665 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:01.041365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:01.052629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.053126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.053559 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.054268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.054721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.055125 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.174388 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:01.177489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:01.182617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ce604b55-b3d6-4b3c-b2d2-825597b1b162 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1612 microversion: 2.1 time: 0.165523 Oct 17 07:09:01.183195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 460/906] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:01 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1612 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:01.186904 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0ad3f42f-fb20-4f24-931b-8c8fbb964e60 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1622 microversion: 2.1 time: 0.150815 Oct 17 07:09:01.188126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 447/907] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:01 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1622 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:01.208611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-bed43b52-393b-4d5b-8658-3726b57512b6 req-f3fba5c2-8cb5-4004-ac8a-538c207039a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1", "name": "network-vif-deleted", "tag": "a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:01.219800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bed43b52-393b-4d5b-8658-3726b57512b6 req-f3fba5c2-8cb5-4004-ac8a-538c207039a9 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.220960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bed43b52-393b-4d5b-8658-3726b57512b6 req-f3fba5c2-8cb5-4004-ac8a-538c207039a9 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.221727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bed43b52-393b-4d5b-8658-3726b57512b6 req-f3fba5c2-8cb5-4004-ac8a-538c207039a9 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.235267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-bed43b52-393b-4d5b-8658-3726b57512b6 req-f3fba5c2-8cb5-4004-ac8a-538c207039a9 service nova] Creating event network-vif-deleted:a2159d1a-d989-48fb-bebc-c0bdbd8eb0d0 for instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 on hv-cinder-84506 Oct 17 07:09:01.241239 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-bed43b52-393b-4d5b-8658-3726b57512b6 req-f3fba5c2-8cb5-4004-ac8a-538c207039a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038031 Oct 17 07:09:01.242099 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 461/908] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:01.422582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:01.423119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:01.429601 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.430149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.430585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.431308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:01.431754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:01.432377 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:01.593011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:01.601715 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1e9137c2-8f5c-4d08-a72c-0f2d2e1ece45 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.182894 Oct 17 07:09:01.602392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 448/909] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:01 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:02.210037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:02.210654 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:02.211367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:02.212581 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:02.218831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:02.219339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:02.219694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:02.219802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:02.220251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:02.220450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:02.220603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:02.220967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:02.221299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:02.221405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:02.221755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:02.222175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:02.304945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:02.306838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:02.313736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5473b54e-929e-4186-9176-d9e1eded750d tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1622 microversion: 2.1 time: 0.106249 Oct 17 07:09:02.314315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 449/910] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:02 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1622 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:02.314772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9c504226-c78d-4bac-9982-1c2ab3e91031 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1612 microversion: 2.1 time: 0.109339 Oct 17 07:09:02.315335 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 462/911] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:02 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:02.625123 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:02.625734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:02.631681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:02.632165 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:02.632604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:02.633292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:02.633862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:02.634799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:02.758241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:02.771913 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b97af0c7-d4ec-4ab7-86e5-e7a2d32d7d7f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.150540 Oct 17 07:09:02.772497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 450/912] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:02 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:03.337293 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:03.337865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:03.338240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:03.338358 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:03.344528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:03.344696 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:03.345019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:03.345172 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:03.345455 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:03.345602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:03.346204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:03.346327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:03.346658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:03.346759 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:03.347082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:03.347180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:03.351250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:03.433477 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:03.434468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:03.441889 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-315e4749-d7ce-4cca-95eb-1a72aa7375b6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1612 microversion: 2.1 time: 0.108015 Oct 17 07:09:03.442667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 451/913] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:03 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1612 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:03.443020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d3efdd90-f08f-41ad-88d0-b61c35b6eae5 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1622 microversion: 2.1 time: 0.109420 Oct 17 07:09:03.443617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 463/914] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:03 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1622 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:03.794372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:03.794902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:03.800846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:03.801320 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:03.801750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:03.802426 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:03.802873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:03.803318 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:03.934265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:03.942265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6696bd8b-68d0-499f-9b19-06b895d5e68d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.151958 Oct 17 07:09:03.942831 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 452/915] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:03 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:04.466210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:04.466835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:04.475939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:04.476425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:04.476925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:04.477048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:04.478150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:04.478256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:04.478691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:04.479109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:04.489653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:04.490500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:04.491117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:04.492028 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:04.492650 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:04.493770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:04.552020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:04.562921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d91049c3-fffc-4b49-bbc2-3be7217f8852 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 200 len: 1325 microversion: 2.1 time: 0.100692 Oct 17 07:09:04.564496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 464/916] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:04 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 1325 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:04.586034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:04.594685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3f113f7e-ac3a-4d66-9725-87ab96daf888 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1330 microversion: 2.1 time: 0.123346 Oct 17 07:09:04.595286 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 453/917] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:04 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:04.965172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:04.965793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:04.971758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:04.972187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:04.972626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:04.973324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:04.973782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:04.974209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:05.122528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:05.132457 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8d903765-7a3b-48b4-8c2f-7d289537e8b0 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.171418 Oct 17 07:09:05.132935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 465/918] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:04 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:05.589234 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:05.590048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:05.597971 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:05.599017 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:05.599690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:05.600459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:05.600980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:05.601469 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:05.617853 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:05.619364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:05.625706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:05.625895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:05.630305 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 HTTP/1.1 Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:09:05.631988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:09:05.633388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '6c2bcdbd-c141-4c72-b7ac-60134fe19975'} Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:09:05.634201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:09:05.635423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:05.636525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:05.636525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:05.636525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:05.636525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:05.638382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:09:05.639489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e2da8382-e44a-490e-b372-996b7f2ea9aa tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 404 len: 111 microversion: 2.1 time: 0.055420 Oct 17 07:09:05.640269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 454/919] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:05 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:09:05.650461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-59f03b67-900c-42da-a8ac-d3b1a71621ac tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '.version_select at 0x7f4acd0c3430>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:05.674979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-59f03b67-900c-42da-a8ac-d3b1a71621ac tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71894821" status: 202 len: 0 microversion: 2.1 time: 0.029805 Oct 17 07:09:05.676059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 455/920] 10.222.0.36 () {58 vars in 1215 bytes} [Mon Oct 17 07:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71894821 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:09:05.696824 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:05.697309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:05.697741 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:05.698190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lazy-loading 'fault' on Instance uuid 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:09:05.743868 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:05.751525 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-32f7950c-6360-41b5-b831-22d2af5fb9b2 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 200 len: 1335 microversion: 2.1 time: 0.137217 Oct 17 07:09:05.755443 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 466/921] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:05 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 1335 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:06.161148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:06.161894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:06.169157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:06.169832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:06.170292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:06.171146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:06.171678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:06.172089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:06.358216 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c869b09e-422f-43a8-8106-9888a2d1b2e6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: .version_select at 0x7f4acd148e50>, body: {"keypair": {"name": "tempest-keypair-1747511651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwjJaxyUZJKcit8LPmv1XH12osuZtrYthub0H9IuFz+QYynDYtHL/mc5FcLCUMRrtColaN6jW75x3qyNPA1cUyRWfzP2oJcIL+mcPyRZGo7FqbQEaWGU4rs3Ebhl/qVtw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:06.366128 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:06.374346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c869b09e-422f-43a8-8106-9888a2d1b2e6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:09:06.374524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ad60f2e7-9e48-4a4e-9dcb-b9daee80fb5f tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.217736 Oct 17 07:09:06.374958 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 456/922] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:06 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:06.378314 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c869b09e-422f-43a8-8106-9888a2d1b2e6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:09:06.402436 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c869b09e-422f-43a8-8106-9888a2d1b2e6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048180 Oct 17 07:09:06.403021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 467/923] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:09:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:09:06.774267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:06.775264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:06.782431 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:06.782993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:06.783573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:06.784313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:06.784767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:06.785226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:06.799835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] HTTP exception thrown: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 could not be found. Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Request method failure captured: Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 HTTP/1.1 Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4r7ZFOUxuecQz5SIb8HGYdw1dHJnbuuRuX9fTDDNFvYs4HGL4tY3ROExPHc_geC7Pmljq35QkMSJBT_0ep-YASoAmGRloynlaGRjBJzdCz2_mBMyPxmxcmAc2yW5UWS9kbocXA8DnDoT3tfZHbranKFVMWWamczrQ-0YndiwWOG-A Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:09:06.801300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0cb1aa55658342fcaf2f493f51e9faeb"}]}] Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: c987a5a52fc641f78054ac0218edcd13 Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 could not be found. Oct 17 07:09:06.802929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1'} Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 could not be found. Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:09:06.803805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 could not be found. Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 could not be found. Oct 17 07:09:06.805175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:06.807575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Returning 404 to user: Instance 42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:09:06.807575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a6a583ee-b666-4008-b73b-153b11859d67 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1" status: 404 len: 111 microversion: 2.1 time: 0.032647 Oct 17 07:09:06.807575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 457/924] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:06 2022] GET /compute/v2.1/servers/42c06c6f-90b4-4f12-b3ec-6c0b6f2a2ea1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:09:06.813420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-868990f0-0f2c-480e-8286-59d166122997 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '.version_select at 0x7f4ad0aceee0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:06.833651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-868990f0-0f2c-480e-8286-59d166122997 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549981407" status: 202 len: 0 microversion: 2.1 time: 0.024853 Oct 17 07:09:06.834220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 468/925] 10.222.0.36 () {58 vars in 1218 bytes} [Mon Oct 17 07:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549981407 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:09:07.402329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:07.403947 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:07.410350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:07.410845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:07.411323 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:07.412077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:07.412535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:07.412961 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:07.632000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:07.641503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ec44db8b-a5f1-4434-b325-f5e32dbd4e80 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.245080 Oct 17 07:09:07.648249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 458/926] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:07 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:07.793425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-b5a81f92-8b33-45bc-95a5-cdab6f42d69c req-8829eb1a-5ac8-4c98-af62-b8abdbfca9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cad347-b818-4dc8-b9ab-26e38b5edf8e", "name": "network-vif-plugged", "status": "completed", "tag": "822458de-2d1e-4246-a342-8e13c6f3ed71"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:07.802788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b5a81f92-8b33-45bc-95a5-cdab6f42d69c req-8829eb1a-5ac8-4c98-af62-b8abdbfca9eb service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:07.803291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b5a81f92-8b33-45bc-95a5-cdab6f42d69c req-8829eb1a-5ac8-4c98-af62-b8abdbfca9eb service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:07.803733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b5a81f92-8b33-45bc-95a5-cdab6f42d69c req-8829eb1a-5ac8-4c98-af62-b8abdbfca9eb service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:07.815054 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-b5a81f92-8b33-45bc-95a5-cdab6f42d69c req-8829eb1a-5ac8-4c98-af62-b8abdbfca9eb service nova] Creating event network-vif-plugged:822458de-2d1e-4246-a342-8e13c6f3ed71 for instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e on hv-cinder-84506 Oct 17 07:09:07.820026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-b5a81f92-8b33-45bc-95a5-cdab6f42d69c req-8829eb1a-5ac8-4c98-af62-b8abdbfca9eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153686 Oct 17 07:09:07.820658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 469/927] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:08.031324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-165765375", "imageRef": "9da137a1-b2bb-4701-8cc7-599b88dc4af2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b"}], "security_groups": [{"name": "tempest-securitygroup--1954365314"}], "key_name": "tempest-keypair-1747511651", "user_data": "}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:08.136896 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] validate_networks() for [('27ad2fb8-8218-4cdb-acaf-8a34b9c3d33b', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:09:08.587471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:09:08.587893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:09:08.588360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:09:08.588763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:09:08.589171 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:09:08.597787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:08.598265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:08.598691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:08.599455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:08.599903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:08.600322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:08.616289 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:09:08.620722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Getting quotas for user 1e37d9ed3751483ebe4141706f46e43a and project 934764e1a1394bfb91688060b594a58a. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:09:08.631797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:09:08.634712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9da137a1-b2bb-4701-8cc7-599b88dc4af2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:09:08.670654 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:08.671381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:08.677731 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:08.678205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:08.678646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:08.679373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:08.679833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:08.680268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:08.697891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-349de044-3869-4a88-9a99-1343e0b82afe tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.670795 Oct 17 07:09:08.698915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 459/928] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:09:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:09:08.710422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-abe600d1-d59e-4343-a5b8-e651a350fc0d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:08.711890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-abe600d1-d59e-4343-a5b8-e651a350fc0d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:08.819866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-abe600d1-d59e-4343-a5b8-e651a350fc0d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:08.829209 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-abe600d1-d59e-4343-a5b8-e651a350fc0d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1241 microversion: 2.1 time: 0.122543 Oct 17 07:09:08.829780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 460/929] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:08 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:08.881058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:08.890056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d0cd46d8-0a95-4920-8370-b01c07ed39cd tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1363 microversion: 2.1 time: 0.223595 Oct 17 07:09:08.890627 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 470/930] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:08 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:09.828322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:09.828817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:09.835413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:09.836084 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:09.836544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:09.837247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:09.837700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:09.838153 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:09.857325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:09.858159 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:09.865272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:09.865378 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:09:09.866059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:09.866490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:09.867316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:09.867803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:09.869052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:09.941917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:09.953145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3738d090-8602-4c6f-9a5c-da559ad3a544 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1237 microversion: 2.1 time: 0.099629 Oct 17 07:09:09.953953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 471/931] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:09 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:09.959111 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:09.959761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:09.965708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:09.966191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:09.966630 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:09.967353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:09.967814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:09.968240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:09.988766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:09.999900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-de06569a-62dc-4e22-b8ff-42099d4d2f73 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 204 len: 0 microversion: 2.1 time: 0.174807 Oct 17 07:09:10.002837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 461/932] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:09:09 2022] DELETE /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:09:10.017928 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:10.019993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:10.028269 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:10.029255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:10.030254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:10.032534 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:10.033288 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:10.033976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:10.160773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:10.172483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-848001ec-3241-4c59-819a-47d9089139c3 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1550 microversion: 2.1 time: 0.217147 Oct 17 07:09:10.176164 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 472/933] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:09 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1550 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:10.196822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:10.197317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:10.203468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:10.203959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:10.204424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:10.205126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:10.205573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:10.206182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:10.217295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:10.226975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-616c6851-1582-498a-b0cb-5c3f3311964b tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1508 microversion: 2.1 time: 0.218307 Oct 17 07:09:10.228450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 462/934] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:10 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:10.289105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-919eed6c-a53b-47b9-beaa-8e0b788885d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096365 Oct 17 07:09:10.289727 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 473/935] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:09:10 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:09:10.978187 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:10.978800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:10.985603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:10.986141 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:10.986582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:10.987494 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:10.987972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:10.988416 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:11.063038 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:11.072421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f71fcdf9-86a1-4193-be6e-b201e7c9721f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1293 microversion: 2.1 time: 0.098205 Oct 17 07:09:11.073524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 463/936] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:10 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:11.250560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:11.252462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:11.259591 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:11.260625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:11.261290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:11.262277 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:11.262984 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:11.263624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:11.280322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-187b7b9e-444c-42d3-b42f-55f9e29a8489 req-0364b6ec-fc45-4a20-b6e2-fb5941e23a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cad347-b818-4dc8-b9ab-26e38b5edf8e", "tag": "822458de-2d1e-4246-a342-8e13c6f3ed71"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:11.291893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-187b7b9e-444c-42d3-b42f-55f9e29a8489 req-0364b6ec-fc45-4a20-b6e2-fb5941e23a4e service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:11.292458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-187b7b9e-444c-42d3-b42f-55f9e29a8489 req-0364b6ec-fc45-4a20-b6e2-fb5941e23a4e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:11.292963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-187b7b9e-444c-42d3-b42f-55f9e29a8489 req-0364b6ec-fc45-4a20-b6e2-fb5941e23a4e service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:11.296975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:11.307899 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-187b7b9e-444c-42d3-b42f-55f9e29a8489 req-0364b6ec-fc45-4a20-b6e2-fb5941e23a4e service nova] Creating event network-changed:822458de-2d1e-4246-a342-8e13c6f3ed71 for instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e on hv-cinder-84506 Oct 17 07:09:11.314321 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-187b7b9e-444c-42d3-b42f-55f9e29a8489 req-0364b6ec-fc45-4a20-b6e2-fb5941e23a4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037915 Oct 17 07:09:11.319535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 464/937] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:11.467646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:11.481571 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a61a8c1a-753a-434b-9dc0-d7f0962b3c0a tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1508 microversion: 2.1 time: 0.234674 Oct 17 07:09:11.482593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 474/938] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:11 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:12.097718 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:12.098557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:12.110245 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:12.110974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:12.111657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:12.113292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:12.114303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:12.114979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:12.287354 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:12.295583 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-147cc215-52dc-4f06-9f4a-a7cd59388b66 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1301 microversion: 2.1 time: 0.202994 Oct 17 07:09:12.296456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 465/939] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:12 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1301 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:12.507583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:12.513784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:12.524864 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:12.525611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:12.526251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:12.527161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:12.527851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:12.528458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:12.957091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:12.969840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bbc94859-cb69-4b0c-9e6a-a290dfb5ba26 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 200 len: 1508 microversion: 2.1 time: 0.468222 Oct 17 07:09:12.987704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 475/940] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:12 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:13.020527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-c6d1edb1-f208-471f-81f3-6c161771de9e req-45f17ed6-655a-4002-ace0-22d91479f031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bd99e6-18f2-46de-bd56-1ddf47ff7204", "name": "network-vif-deleted", "tag": "df638f88-4d05-4fe8-b626-15417ca804c5"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:13.031140 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c6d1edb1-f208-471f-81f3-6c161771de9e req-45f17ed6-655a-4002-ace0-22d91479f031 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:13.044698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c6d1edb1-f208-471f-81f3-6c161771de9e req-45f17ed6-655a-4002-ace0-22d91479f031 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:13.045516 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c6d1edb1-f208-471f-81f3-6c161771de9e req-45f17ed6-655a-4002-ace0-22d91479f031 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:13.066629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-c6d1edb1-f208-471f-81f3-6c161771de9e req-45f17ed6-655a-4002-ace0-22d91479f031 service nova] Creating event network-vif-deleted:df638f88-4d05-4fe8-b626-15417ca804c5 for instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 on hv-cinder-84506 Oct 17 07:09:13.090203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-c6d1edb1-f208-471f-81f3-6c161771de9e req-45f17ed6-655a-4002-ace0-22d91479f031 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073654 Oct 17 07:09:13.091193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 466/941] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:13.323343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:13.324090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:13.330996 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:13.340066 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:13.340663 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:13.341653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:13.342492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:13.343444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:13.515392 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:13.523514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d1557ff4-a58a-44f1-b5b9-0e0d55fd0e1a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1299 microversion: 2.1 time: 0.205518 Oct 17 07:09:13.526719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 476/942] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:13 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:13.996249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:13.996963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: c1bd99e6-18f2-46de-bd56-1ddf47ff7204] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:14.006839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.007606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.008858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.010102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.010738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.011364 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.029860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] HTTP exception thrown: Instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 could not be found. Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Request method failure captured: Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 HTTP/1.1 Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4r7ZFOUxuecQz5SIb8HGYdw1dHJnbuuRuX9fTDDNFvYs4HGL4tY3ROExPHc_geC7Pmljq35QkMSJBT_0ep-YASoAmGRloynlaGRjBJzdCz2_mBMyPxmxcmAc2yW5UWS9kbocXA8DnDoT3tfZHbranKFVMWWamczrQ-0YndiwWOG-A Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:09:14.032398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0cb1aa55658342fcaf2f493f51e9faeb"}]}] Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: c987a5a52fc641f78054ac0218edcd13 Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 could not be found. Oct 17 07:09:14.034568 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'c1bd99e6-18f2-46de-bd56-1ddf47ff7204'} Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 could not be found. Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:09:14.035773 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 could not be found. Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 could not be found. Oct 17 07:09:14.039707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:09:14.040953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Returning 404 to user: Instance c1bd99e6-18f2-46de-bd56-1ddf47ff7204 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:09:14.040953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cde18178-57f4-4c57-b7ca-95f4c4716d77 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204" status: 404 len: 111 microversion: 2.1 time: 0.048122 Oct 17 07:09:14.043380 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 467/943] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:13 2022] GET /compute/v2.1/servers/c1bd99e6-18f2-46de-bd56-1ddf47ff7204 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:09:14.047262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:14.047894 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:14.058478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.059229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.059956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.062023 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.062760 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.063279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.099264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:09:14.235768 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0716631d-d294-40fd-bb64-96ff584fd812 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 204 len: 0 microversion: 2.1 time: 0.192619 Oct 17 07:09:14.236605 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 477/944] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:09:14 2022] DELETE /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 07:09:14.247546 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:14.248452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:14.256340 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.257011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.265277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.266176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.266662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.267121 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.560424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:14.562190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:14.570090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:14.583625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.592045 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-65ef8f6e-b400-4094-917f-73484ee424ce tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.341097 Oct 17 07:09:14.592363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 468/945] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:14 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:14.593223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.593782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.594725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:14.595463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:14.595951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:14.802170 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:14.813786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-098b99d7-efb6-4a19-b55d-dc15545fd0db tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.258947 Oct 17 07:09:14.815320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 478/946] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:14 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:15.139168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-7a8fa558-a079-4f6f-b631-f8c20d86b53b req-d8f9e842-e7a6-4e4f-9a20-6bb4c475d7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba3dff1-3b70-45d9-9f95-34e825c3601a", "tag": "182f3c3c-a2a4-4cf7-a91e-f07cd76ea450"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:15.153866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7a8fa558-a079-4f6f-b631-f8c20d86b53b req-d8f9e842-e7a6-4e4f-9a20-6bb4c475d7da service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:15.154645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7a8fa558-a079-4f6f-b631-f8c20d86b53b req-d8f9e842-e7a6-4e4f-9a20-6bb4c475d7da service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:15.155254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7a8fa558-a079-4f6f-b631-f8c20d86b53b req-d8f9e842-e7a6-4e4f-9a20-6bb4c475d7da service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:15.168421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-7a8fa558-a079-4f6f-b631-f8c20d86b53b req-d8f9e842-e7a6-4e4f-9a20-6bb4c475d7da service nova] Creating event network-changed:182f3c3c-a2a4-4cf7-a91e-f07cd76ea450 for instance eba3dff1-3b70-45d9-9f95-34e825c3601a on hv-cinder-84506 Oct 17 07:09:15.174203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-7a8fa558-a079-4f6f-b631-f8c20d86b53b req-d8f9e842-e7a6-4e4f-9a20-6bb4c475d7da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039128 Oct 17 07:09:15.174783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 469/947] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:15.615594 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:15.616921 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:15.624613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:15.625104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:15.625698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:15.626599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:15.627241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:15.627655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:15.838659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:15.839385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:15.846844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:15.847376 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:15.847817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:15.848549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:15.849022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:15.849455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:16.148225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:16.150611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:16.159300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6227c4cd-9867-47c2-b971-a23d27290529 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.549073 Oct 17 07:09:16.167446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 479/948] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:15 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:16.169977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fb27cfdd-1d8f-45c9-aa50-ed5c6ac40283 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.335354 Oct 17 07:09:16.170580 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 470/949] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:15 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:17.192107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:17.192732 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:17.199253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:17.199894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:17.201258 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:17.209147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:17.209865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:17.210484 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:17.211550 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:17.213352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:17.213962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:17.219049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:17.220221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:17.228503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:17.229709 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:17.230262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:17.230765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:17.649813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:17.653539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:17.661128 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4917ef70-8b99-4821-ba96-96918e9bbdf7 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1522 microversion: 2.1 time: 0.473336 Oct 17 07:09:17.662445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 480/950] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:17 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:17.673737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:17.683310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8c4136f2-c389-4888-94e5-85b5bc7edd2b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.487994 Oct 17 07:09:17.684175 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 471/951] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:17 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:17.886664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-81881422-edab-4f55-8500-0024fb365c2f req-b3d0a30f-c41a-4b0a-8415-ad90293091c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ed23e6-2fa8-4fbb-b1be-2e501f391f74", "name": "network-vif-deleted", "tag": "8dc5299c-dfbd-4838-a456-06f29fab46dc"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:17.927711 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-81881422-edab-4f55-8500-0024fb365c2f req-b3d0a30f-c41a-4b0a-8415-ad90293091c4 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:17.928606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-81881422-edab-4f55-8500-0024fb365c2f req-b3d0a30f-c41a-4b0a-8415-ad90293091c4 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:17.929220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-81881422-edab-4f55-8500-0024fb365c2f req-b3d0a30f-c41a-4b0a-8415-ad90293091c4 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:17.948856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-81881422-edab-4f55-8500-0024fb365c2f req-b3d0a30f-c41a-4b0a-8415-ad90293091c4 service nova] Creating event network-vif-deleted:8dc5299c-dfbd-4838-a456-06f29fab46dc for instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 on hv-cinder-84506 Oct 17 07:09:17.962462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-81881422-edab-4f55-8500-0024fb365c2f req-b3d0a30f-c41a-4b0a-8415-ad90293091c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080357 Oct 17 07:09:17.963820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 481/952] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:18.684818 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:18.686073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:18.688946 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:18.694620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:18.695110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:18.695576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:18.697062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:18.697527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:18.697952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:18.710050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:18.710481 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:18.723029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:18.723583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:18.724020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:18.724736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:18.725189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:18.725615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:18.766979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:18.767496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:18.767932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:18.768390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lazy-loading 'fault' on Instance uuid 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:09:18.828946 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=8 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:18.860752 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c987a5a52fc641f78054ac0218edcd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb1aa55658342fcaf2f493f51e9faeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:18.871244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-217ebde0-cd15-4f25-b048-a80ae9ca6a23 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 200 len: 1311 microversion: 2.1 time: 0.190199 Oct 17 07:09:18.885243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 472/953] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:18 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:19.052592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:19.060723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-004275c9-5406-4963-9ccc-618144d9cf73 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.355592 Oct 17 07:09:19.061615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 482/954] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:18 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:19.298488 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:19.299938 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:19.310645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:19.311619 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:19.312558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:19.313769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:19.314319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:19.314873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:19.351549 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c7247b6e-be71-497a-92ab-798c419625b1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/ips" status: 200 len: 151 microversion: 2.20 time: 0.058711 Oct 17 07:09:19.355894 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 473/955] 10.222.0.36 () {60 vars in 1289 bytes} [Mon Oct 17 07:09:19 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/ips => generated 151 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:09:19.899372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:19.900079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] [instance: 21ed23e6-2fa8-4fbb-b1be-2e501f391f74] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:19.907772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:19.908309 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:19.908930 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:19.909939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:19.910470 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:19.910917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:20.086782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:20.088417 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:20.089465 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] HTTP exception thrown: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 could not be found. Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Request method failure captured: Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 HTTP/1.1 Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4r7ZFOUxuecQz5SIb8HGYdw1dHJnbuuRuX9fTDDNFvYs4HGL4tY3ROExPHc_geC7Pmljq35QkMSJBT_0ep-YASoAmGRloynlaGRjBJzdCz2_mBMyPxmxcmAc2yW5UWS9kbocXA8DnDoT3tfZHbranKFVMWWamczrQ-0YndiwWOG-A Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:09:20.092365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0cb1aa55658342fcaf2f493f51e9faeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0cb1aa55658342fcaf2f493f51e9faeb"}]}] Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 0cb1aa55658342fcaf2f493f51e9faeb Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-891153917 Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: c987a5a52fc641f78054ac0218edcd13 Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-891153917-project Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 could not be found. Oct 17 07:09:20.093748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '21ed23e6-2fa8-4fbb-b1be-2e501f391f74'} Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 could not be found. Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:09:20.094499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 could not be found. Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 could not be found. Oct 17 07:09:20.095805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:09:20.096955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] Returning 404 to user: Instance 21ed23e6-2fa8-4fbb-b1be-2e501f391f74 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:09:20.096955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fd1ec0ec-52b5-436f-9d24-089b57d0b941 tempest-ServerRescueNegativeTestJSON-891153917 tempest-ServerRescueNegativeTestJSON-891153917-project] 10.222.0.36 "GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74" status: 404 len: 111 microversion: 2.1 time: 0.200834 Oct 17 07:09:20.096955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 483/956] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:19 2022] GET /compute/v2.1/servers/21ed23e6-2fa8-4fbb-b1be-2e501f391f74 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:09:20.112676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:20.113190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:20.116801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:20.120669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:20.121219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:20.123855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:20.404352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:20.423003 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-67193f20-7bd0-473d-8818-886835bf8dd7 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.340679 Oct 17 07:09:20.428558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 474/957] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:20 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:21.448380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:21.449006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:21.498963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:21.500407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:21.501070 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:21.502733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:21.503753 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:21.504364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:21.873568 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:21.883927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a5aed3e9-ad89-4743-8a91-87227dedca49 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.439487 Oct 17 07:09:21.885212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 484/958] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:21 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:22.055088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:22.055640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:22.071052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:22.071577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:22.073134 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:22.074697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:22.076777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:22.078881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:22.138649 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lazy-loading 'flavor' on Instance uuid 59b0cefb-566e-491e-adc2-a28637e2aa34 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:09:22.584233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d102a3f3-bcee-4916-bcec-9d899ce08d58 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/action" status: 202 len: 0 microversion: 2.20 time: 0.533654 Oct 17 07:09:22.591119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 475/959] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 17 07:09:22 2022] POST /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:09:22.599931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:22.600611 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:22.612208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:22.612736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:22.614393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:22.616835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:22.619500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:22.619973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:22.918978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:22.920194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:22.929708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:22.930604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:22.931242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:22.935098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:22.938090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:22.940125 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:22.967585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:22.988647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:22.991462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:22.993399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9015d926-089d-4139-a9f5-11eec681ef19 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.397787 Oct 17 07:09:22.999769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 485/960] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:22 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:23.319315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:23.332211 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8911a5c6-1e7c-4a27-9bdd-4892d35bf66a tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.422162 Oct 17 07:09:23.334455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 476/961] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:22 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:24.028225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:24.029167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:24.037404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:24.038283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:24.038872 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:24.040455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:24.041212 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:24.041792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:24.237236 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0984288d-f7ad-450c-9f4f-f4b3fc12b048 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Action: 'create', calling method: .version_select at 0x7f4acd0cf820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1294755818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdBWahIcl1Fj00/Ek8OvcD4qnH3gXhGhbZqhqJNB6dE/HYFKEI4DLYshkIJZQUcds6vWgmZBAMqNj/6K7gxa7DMNfbgecedO/NayL+TuIHZeU3louAm4a7ePUZ5jm26lg=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:24.264165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-0984288d-f7ad-450c-9f4f-f4b3fc12b048 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Getting quotas for project 3326642f5c9e4103aa3c72f47b5d23b5. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:09:24.269703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-0984288d-f7ad-450c-9f4f-f4b3fc12b048 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Getting quotas for user 455a8022fa3543b2a0ce0cdfc1512f73 and project 3326642f5c9e4103aa3c72f47b5d23b5. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:09:24.301981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0984288d-f7ad-450c-9f4f-f4b3fc12b048 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.383314 Oct 17 07:09:24.312019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 486/962] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:09:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:24.359711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:24.360227 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:24.360773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:24.378461 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:24.378954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:24.379327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:24.379461 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:24.380123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:24.380572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:24.380855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:24.380989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:24.382117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d68b6d3a-7d20-4e53-b2f0-404f89445d02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.360530 Oct 17 07:09:24.386956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 477/963] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:24 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:09:24.722658 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:24.734745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2db02544-b9e8-4a33-ad5a-3dae46e3723b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.378851 Oct 17 07:09:24.736204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 487/964] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:24 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:25.416035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:25.417314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:25.424189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:25.424919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:25.425512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:25.426436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:25.427082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:25.428122 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:25.676677 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:25.710364 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:25.713658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:25.715572 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4695ea7a-953d-4479-b796-c8bff5c2fb54 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.303921 Oct 17 07:09:25.732079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 478/965] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:25 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:25.759107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:25.760341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:25.773453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:25.774506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:25.774954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:25.775702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:25.783751 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:25.787904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:26.014767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:26.022964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e67068ec-c527-412b-95ea-fbd91f4706c2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.268170 Oct 17 07:09:26.024992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 488/966] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:25 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:26.053024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-030c8c4e-9f14-4502-9389-152487523979 req-29f5e671-dcdd-4460-8a23-d6a9af975645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba3dff1-3b70-45d9-9f95-34e825c3601a", "name": "network-vif-plugged", "status": "completed", "tag": "182f3c3c-a2a4-4cf7-a91e-f07cd76ea450"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:26.067128 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-030c8c4e-9f14-4502-9389-152487523979 req-29f5e671-dcdd-4460-8a23-d6a9af975645 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:26.068279 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-030c8c4e-9f14-4502-9389-152487523979 req-29f5e671-dcdd-4460-8a23-d6a9af975645 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:26.070035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-030c8c4e-9f14-4502-9389-152487523979 req-29f5e671-dcdd-4460-8a23-d6a9af975645 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:26.087848 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-030c8c4e-9f14-4502-9389-152487523979 req-29f5e671-dcdd-4460-8a23-d6a9af975645 service nova] Creating event network-vif-plugged:182f3c3c-a2a4-4cf7-a91e-f07cd76ea450 for instance eba3dff1-3b70-45d9-9f95-34e825c3601a on hv-cinder-84506 Oct 17 07:09:26.094642 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-030c8c4e-9f14-4502-9389-152487523979 req-29f5e671-dcdd-4460-8a23-d6a9af975645 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045011 Oct 17 07:09:26.096467 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 479/967] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:26.744869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:26.747289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:26.769327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:26.774267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:26.775398 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:26.776788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:26.777815 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:26.779042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:27.049762 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:27.050479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:27.060538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:27.061044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:27.061519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:27.062270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:27.069863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:27.070976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:27.071598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:27.085935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:27.087618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:27.097096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4067a992-8147-4f1c-acec-b81aeffa87c3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.355779 Oct 17 07:09:27.098118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 489/968] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:26 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:27.257219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:27.276967 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fbe26743-7298-49b0-afc2-6532ec59550b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1367 microversion: 2.1 time: 0.232111 Oct 17 07:09:27.277817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 480/969] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:27 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:28.125718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:28.126895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:28.141489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:28.142374 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:28.143069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:28.143920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:28.144587 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:28.145659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:28.301644 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:28.302225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:28.316613 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:28.319176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:28.319717 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:28.320169 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:28.321044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:28.321498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:28.321933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:28.326235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:28.327714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:28.329230 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6c633493-66ab-4663-b7b9-bc46569a9bde tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.208153 Oct 17 07:09:28.329981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 490/970] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:28 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:28.493037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:28.501422 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-44fdb143-6845-4faf-946b-9efed9615659 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1557 microversion: 2.1 time: 0.204251 Oct 17 07:09:28.502344 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 481/971] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:28 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:28.527789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:28.528757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:28.536275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:28.536775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:28.537212 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:28.537919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:28.538373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:28.538790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:28.625124 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fef0e276-d8fd-4efe-ac27-01bb9a3765f5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102630 Oct 17 07:09:28.626312 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 491/972] 10.222.0.36 () {58 vars in 1275 bytes} [Mon Oct 17 07:09:28 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:09:29.359769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:29.368408 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:29.380255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:29.380769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:29.381383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:29.382361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:29.383034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:29.385645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:29.391510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:29.556935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:29.566846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:29.569813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:29.571518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5fed0e61-67e4-4026-801e-8d151e886b93 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.218409 Oct 17 07:09:29.572606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 482/973] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:29 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:29.839407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-7595ae85-cd59-464e-9a3d-dd969112df8f req-efcc6a40-7878-4bcb-b7ec-f0829558face service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba3dff1-3b70-45d9-9f95-34e825c3601a", "tag": "182f3c3c-a2a4-4cf7-a91e-f07cd76ea450"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:29.844434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:29.849849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7595ae85-cd59-464e-9a3d-dd969112df8f req-efcc6a40-7878-4bcb-b7ec-f0829558face service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:29.850483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7595ae85-cd59-464e-9a3d-dd969112df8f req-efcc6a40-7878-4bcb-b7ec-f0829558face service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:29.851032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7595ae85-cd59-464e-9a3d-dd969112df8f req-efcc6a40-7878-4bcb-b7ec-f0829558face service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:29.865021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-7595ae85-cd59-464e-9a3d-dd969112df8f req-efcc6a40-7878-4bcb-b7ec-f0829558face service nova] Creating event network-changed:182f3c3c-a2a4-4cf7-a91e-f07cd76ea450 for instance eba3dff1-3b70-45d9-9f95-34e825c3601a on hv-cinder-84506 Oct 17 07:09:29.877936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-7595ae85-cd59-464e-9a3d-dd969112df8f req-efcc6a40-7878-4bcb-b7ec-f0829558face service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043291 Oct 17 07:09:29.880762 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 492/974] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:30.600260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:30.600989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:30.608961 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:30.609449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:30.609888 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:30.610582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:30.611244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:30.611668 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:30.775476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:30.783805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:30.785533 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:30.786713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8708bc4a-7d55-40b1-aae7-a099a4ae4093 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.191415 Oct 17 07:09:30.798436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 483/975] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:30 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:31.814578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:31.815684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:31.824173 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:31.824763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:31.825279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:31.826304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:31.826768 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:31.827197 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:31.975424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:31.984222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:31.985685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:31.986859 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-264d4715-cc40-43cc-835e-18d9de899d12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.176475 Oct 17 07:09:31.987445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 493/976] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:31 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:33.012687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:33.013311 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:33.019866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:33.020363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:33.020794 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:33.021515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:33.022029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:33.022448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:33.168459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:33.177609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:33.179267 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:33.180561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-70097d0b-cf6f-4ee3-96d3-c0e558cb0144 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.171755 Oct 17 07:09:33.183009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 484/977] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:33 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:34.210125 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:34.211437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:34.217769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:34.218321 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:34.218835 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:34.219635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:34.220086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:34.220962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:34.279902 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:34.369914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:34.378195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:34.379679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:34.380857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f35bb5c4-b6bd-4da5-b428-9336994f6068 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.175444 Oct 17 07:09:34.381928 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 494/978] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:34 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:35.670740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:35.671382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:35.677777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:35.678264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:35.678698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:35.679824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:35.680274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:35.680866 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:35.846796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:35.855500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:35.856968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:35.858165 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-96d2dfd4-7184-4ac2-8e92-ddc8a8ef932f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.456507 Oct 17 07:09:35.858723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 485/979] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:35 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:36.884533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:36.885142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:36.892063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:36.892698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:36.893139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:36.893972 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:36.894521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:36.895344 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:37.026785 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:37.035223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:37.036801 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:37.037905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c68a6c19-52a0-41a9-9bf5-693bc17d9a02 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.158130 Oct 17 07:09:37.038451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 495/980] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:36 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:38.064159 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:38.064852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:38.071735 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:38.072287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:38.072786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:38.073541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:38.074065 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:38.074556 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:38.223989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:38.232578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:38.234008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:38.235165 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3ca2ef1f-5445-4430-97d3-082ca0fc402e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.175452 Oct 17 07:09:38.235752 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 486/981] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:38 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:09:39.261222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:39.261837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:39.268330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:39.268868 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:39.269290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:39.269982 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:39.270438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:39.270860 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:39.397557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:39.405814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:39.407412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:39.408541 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cd44f88e-5d39-4815-8655-17a1eb99b9f3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1740 microversion: 2.20 time: 0.151272 Oct 17 07:09:39.409130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 496/982] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:39 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:40.435026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:40.435723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:40.438270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:40.444579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:40.445170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:40.445612 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:40.446375 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:40.446838 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:40.447372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:40.590078 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:40.598204 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:40.599765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:40.600820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-220cfc05-fec0-4cc6-8e85-5be57c567681 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1740 microversion: 2.20 time: 0.170298 Oct 17 07:09:40.601465 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 487/983] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:40 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:41.628661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:41.629294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:41.637272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:41.638203 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:41.638651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:41.639381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:41.639836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:41.640261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:41.808764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:41.818313 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:41.820937 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:41.822140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a92e5234-dfb4-4ffd-9e0a-e4aac90110e5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.197916 Oct 17 07:09:41.823043 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 497/984] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:41 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:41.950081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-7617e95d-5085-432e-baaf-b926c375c0c6 req-da213d4b-6156-4f9a-b1ad-bb1d055525ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "name": "network-vif-plugged", "status": "completed", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:41.964325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7617e95d-5085-432e-baaf-b926c375c0c6 req-da213d4b-6156-4f9a-b1ad-bb1d055525ca service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:41.964811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7617e95d-5085-432e-baaf-b926c375c0c6 req-da213d4b-6156-4f9a-b1ad-bb1d055525ca service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:41.965281 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-7617e95d-5085-432e-baaf-b926c375c0c6 req-da213d4b-6156-4f9a-b1ad-bb1d055525ca service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:41.986138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-7617e95d-5085-432e-baaf-b926c375c0c6 req-da213d4b-6156-4f9a-b1ad-bb1d055525ca service nova] Creating event network-vif-plugged:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:09:41.995423 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-7617e95d-5085-432e-baaf-b926c375c0c6 req-da213d4b-6156-4f9a-b1ad-bb1d055525ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050736 Oct 17 07:09:41.996551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 488/985] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:42.850935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:42.851491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:42.859357 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:42.859681 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:42.860157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:42.861378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:42.861863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:42.862319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:42.995814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:43.003914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:43.005356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:43.006507 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e3238a85-3bb1-4b37-9ce0-da157c0e3de2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.160261 Oct 17 07:09:43.009160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 498/986] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:42 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:44.035915 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:44.037335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:44.055796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:44.059692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:44.060457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:44.061493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:44.062159 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:44.062776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:44.078006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-886906750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1294755818", "security_groups": [{"name": "tempest-secgroup-smoke-307164782"}], "networks": [{"uuid": "637c7d57-579d-4bbe-8cae-e0615803810f"}], "block_device_mapping_v2": [{"uuid": "43a2aa61-8826-4add-b29f-11b02f101347", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:44.301271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] validate_networks() for [('637c7d57-579d-4bbe-8cae-e0615803810f', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:09:44.350021 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:44.369392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:44.371621 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:44.373203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6de006c6-ea9d-43aa-966e-0b3b1b3cfabf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.342816 Oct 17 07:09:44.399092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 489/987] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:44 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:45.104340 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:09:45.105088 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:09:45.105756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:09:45.106401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:09:45.106977 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:09:45.116986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:45.117724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:45.118193 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:45.119074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:45.119578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:45.120003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:45.138362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Getting quotas for project 3326642f5c9e4103aa3c72f47b5d23b5. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:09:45.142595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Getting quotas for user 455a8022fa3543b2a0ce0cdfc1512f73 and project 3326642f5c9e4103aa3c72f47b5d23b5. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:09:45.211568 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:09:45.214065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43a2aa61-8826-4add-b29f-11b02f101347',volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:09:45.363126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c1b6ba85-acb7-4740-a123-c6ace07fd293 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.290272 Oct 17 07:09:45.370843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 499/988] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:09:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:09:45.376734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-77a9c014-bd0a-4c08-af65-58e70e794031 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:45.377514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-77a9c014-bd0a-4c08-af65-58e70e794031 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:45.405334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:45.406116 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:45.415653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:45.416478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:45.417726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:45.418620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:45.419259 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:45.419890 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:45.464453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-77a9c014-bd0a-4c08-af65-58e70e794031 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:45.472507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-77a9c014-bd0a-4c08-af65-58e70e794031 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1088 microversion: 2.1 time: 0.100204 Oct 17 07:09:45.485049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 490/989] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:45 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1088 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:45.625052 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:45.635370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:45.637242 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:45.639183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3a47f4f0-6ba5-45ae-9aef-ca070bc9710e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.237518 Oct 17 07:09:45.643252 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 500/990] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:45 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:46.498619 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:46.499424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:46.506815 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:46.509750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:46.510487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:46.511284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:46.511777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:46.512207 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:46.593539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:46.602216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9f3e621f-f1c8-4b43-b6a3-ce403182d2a0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1186 microversion: 2.1 time: 0.107913 Oct 17 07:09:46.615232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 491/991] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:46 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:46.667015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:46.667595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:46.674556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:46.675322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:46.675951 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:46.676817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:46.677268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:46.677687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:46.700597 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:46.836147 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:46.848887 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:46.850508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:46.851843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f01874bd-fc75-4545-8bf6-eb744623be6e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.189661 Oct 17 07:09:46.852476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 501/992] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:46 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:47.626428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:47.627814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:47.644386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:47.644895 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:47.648103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:47.650653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:47.651822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:47.653223 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:47.797436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:47.808790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3c89abaf-20d5-4e5d-9fbc-2a3145d17423 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1204 microversion: 2.1 time: 0.186662 Oct 17 07:09:47.811656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 492/993] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:47 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1204 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:47.887944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:47.889665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:47.906017 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:47.909417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:47.913119 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:47.916275 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:47.917172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:47.919192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:48.167345 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:48.176463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:48.181382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:48.183430 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-15a16ee5-a7c0-4e6e-928a-9e82e675d259 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.302172 Oct 17 07:09:48.184693 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 502/994] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:47 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:48.837078 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:48.839955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:48.848844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:48.849329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:48.849770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:48.855778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:48.856447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:48.856968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:49.153104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:49.166005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-21ea4fbb-80f6-46ef-a346-c9a1cbf3e6c5 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.336251 Oct 17 07:09:49.166923 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 493/995] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:48 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:49.206286 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-fd3e2019-3066-4091-aefb-fac47ec247bc req-8b0aa621-ffc9-4df8-8c42-f3743b5d1fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:49.218742 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:49.219386 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:49.226872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fd3e2019-3066-4091-aefb-fac47ec247bc req-8b0aa621-ffc9-4df8-8c42-f3743b5d1fe3 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:49.227754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fd3e2019-3066-4091-aefb-fac47ec247bc req-8b0aa621-ffc9-4df8-8c42-f3743b5d1fe3 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:49.229593 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fd3e2019-3066-4091-aefb-fac47ec247bc req-8b0aa621-ffc9-4df8-8c42-f3743b5d1fe3 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:49.236400 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:49.238338 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:49.239062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:49.239965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:49.243089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:49.245203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:49.257684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-fd3e2019-3066-4091-aefb-fac47ec247bc req-8b0aa621-ffc9-4df8-8c42-f3743b5d1fe3 service nova] Creating event network-changed:e3bd85c0-a0fd-4b86-940e-1ba4d645601f for instance c06f20c4-d1f2-4a52-95de-dae8c232c555 on hv-cinder-84506 Oct 17 07:09:49.273104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-fd3e2019-3066-4091-aefb-fac47ec247bc req-8b0aa621-ffc9-4df8-8c42-f3743b5d1fe3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070730 Oct 17 07:09:49.273995 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 503/996] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:09:49.651863 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:49.662185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:49.664263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:49.665457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-53288fdf-ce0c-47d9-b15c-5eff70c209c5 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.450428 Oct 17 07:09:49.666014 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 494/997] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:49 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:50.192093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:50.193090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:50.202636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:50.203145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:50.203665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:50.204415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:50.204882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:50.205381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:50.488445 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:50.497731 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5bc6dd25-5d36-4a83-9a23-532ad307a154 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.311372 Oct 17 07:09:50.499126 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 504/998] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:50 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:50.691784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:50.692396 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:50.701797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:50.702180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:50.702632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:50.709712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:50.710315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:50.710770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:50.961010 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:50.971407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:50.976497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:50.978144 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-67b0dc48-afc2-4ec9-b69e-ebb4c469ad12 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.290273 Oct 17 07:09:50.994969 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 495/999] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:50 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:51.524979 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:51.526659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:51.539639 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:51.540676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:51.541425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:51.542807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:51.543556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:51.544221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:51.712649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:51.721462 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e3218c50-2399-48d7-9762-8a21d6838d45 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.202617 Oct 17 07:09:51.722379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 505/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:51 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:52.005316 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:52.005911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:52.017684 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:52.019291 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:52.020186 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:52.021314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:52.022034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:52.023314 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:52.202613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:52.211247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:52.212922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:52.214074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0a86b8ae-2126-4d32-8b06-876a704d0414 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.212617 Oct 17 07:09:52.214798 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 496/1001] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:52 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:52.746353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:52.747120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:52.753710 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:52.754625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:52.755323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:52.756261 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:52.759932 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:52.760582 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:52.950143 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:52.980464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5cd946c7-3287-4daf-b90a-d5b34db7c201 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.229796 Oct 17 07:09:52.989763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 506/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:52 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:53.239911 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:53.240521 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:53.247716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:53.259535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:53.260188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:53.261098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:53.261719 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:53.262315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:53.408722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:53.417890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:53.419146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:53.420332 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-76cc9f21-66ce-49f6-a3ff-776e5065105c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1735 microversion: 2.20 time: 0.184355 Oct 17 07:09:53.420879 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 497/1003] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:53 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:53.997109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:53.997714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:54.004250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:54.004679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:54.005103 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:54.005810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:54.006273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:54.009953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:54.139505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:54.147631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd1b7292-b940-420d-b2b8-2540eb82038d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.154294 Oct 17 07:09:54.148229 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 507/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:53 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:54.445975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:54.446713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:54.453820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:54.454444 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:54.454984 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:54.455824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:54.456504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:54.457121 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:54.677149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:54.685939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:54.687443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:54.688619 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-322ab654-9955-454b-87e3-87ca2a2c8006 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1717 microversion: 2.20 time: 0.246526 Oct 17 07:09:54.689181 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 498/1005] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:54 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1717 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:55.169816 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:55.170420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:55.172978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:55.173663 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:55.179699 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:55.180183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:55.180615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:55.181353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:55.181939 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:55.182410 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:55.312444 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:55.320452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-86a853fd-11ff-4b7d-a381-f44fdc69ddd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.154421 Oct 17 07:09:55.321003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 508/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:55 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:55.322456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:55.323043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:55.330616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:55.331111 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:55.331583 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:55.332327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:55.332782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:55.333206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:55.356988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-738d6ce4-ae65-4c24-8399-7f9884eca31d tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/ips" status: 200 len: 146 microversion: 2.1 time: 0.039047 Oct 17 07:09:55.357560 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 499/1007] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:09:55 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:09:55.715063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:55.715696 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:55.721766 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:55.722247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:55.723040 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:55.723759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:55.724205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:55.724624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:55.851051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:55.860094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:55.861533 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:55.862686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-91c05228-284b-4b65-a138-f5fb7e7cdfe7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1717 microversion: 2.20 time: 0.151549 Oct 17 07:09:55.863254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 509/1008] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:55 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:56.347659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:56.348313 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:56.350748 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:56.356070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:56.356554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:56.356989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:56.357708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:56.358166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:56.358615 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:56.496603 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:56.500066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=100 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:56.505135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-615cb832-a01f-4e3b-99da-f77520bade1f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.161335 Oct 17 07:09:56.505699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 500/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:56 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:56.700618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46467dc3-a8d7-4cc3-98c0-cca382aa7807"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:56.702960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:56.709420 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:56.709908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:56.710369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:56.711060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:56.711545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:56.711971 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:56.888491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:56.889134 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:56.895304 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:56.895783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:56.896206 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:56.896881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:56.897366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:56.898295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:57.026539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:57.034732 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:57.036219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:57.037416 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-279f4b99-f7f3-4671-a109-de44e4b8e3bf tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1717 microversion: 2.20 time: 0.153031 Oct 17 07:09:57.038057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 501/1010] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:56 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:57.529629 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:57.530257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:57.536790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:57.537268 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:57.537697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:57.539023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:57.539492 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:57.539912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:57.589866 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-313aa409-eb36-4abb-94d8-238476a7fe19 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893297 Oct 17 07:09:57.591291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 510/1011] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:09:56 2022] POST /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:57.693893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:57.701925 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a41f158b-e965-4cfe-8df8-532a99b9758a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.176115 Oct 17 07:09:57.702480 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 502/1012] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:57 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:09:57.986162 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-2c909a4a-3195-4990-87c2-016dc23c6c67 req-3f49b566-c94d-4bb2-8fb8-59717018de97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "name": "network-vif-unplugged", "status": "completed", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:57.996762 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2c909a4a-3195-4990-87c2-016dc23c6c67 req-3f49b566-c94d-4bb2-8fb8-59717018de97 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:57.997493 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2c909a4a-3195-4990-87c2-016dc23c6c67 req-3f49b566-c94d-4bb2-8fb8-59717018de97 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:57.998045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2c909a4a-3195-4990-87c2-016dc23c6c67 req-3f49b566-c94d-4bb2-8fb8-59717018de97 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.012225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-2c909a4a-3195-4990-87c2-016dc23c6c67 req-3f49b566-c94d-4bb2-8fb8-59717018de97 service nova] Creating event network-vif-unplugged:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:09:58.017656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-2c909a4a-3195-4990-87c2-016dc23c6c67 req-3f49b566-c94d-4bb2-8fb8-59717018de97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035963 Oct 17 07:09:58.018757 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 511/1013] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:09:58.063879 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:58.064493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:58.070635 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.071271 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.071714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.072442 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.072901 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.073329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.208858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:58.217723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:58.219189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:58.220435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-572e514d-da9c-4b58-8822-cfea04118f61 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1660 microversion: 2.20 time: 0.160488 Oct 17 07:09:58.220984 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 503/1014] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:58 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1660 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:58.246062 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86df490d-f1e9-4814-83ab-c26d1315a79c"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:58.248527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:58.254546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.255031 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.255501 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.256190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.257195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.257656 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.546634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a1f36c20-8d36-4574-9feb-66f0758917a1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305451 Oct 17 07:09:58.547270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 512/1015] 10.222.0.36 () {62 vars in 1364 bytes} [Mon Oct 17 07:09:58 2022] POST /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 07:09:58.672968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:58.673462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:58.680272 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.680700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.681164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.681860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.682310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.682727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.723926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:58.724570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:58.730500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.730948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.731498 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.732192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:58.732646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:58.733064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:58.870064 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:58.878655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3f17b0a2-c983-4153-858e-ebf839ec1113 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.158243 Oct 17 07:09:58.879359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 513/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:58 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:09:58.940700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8fea595e-332a-49db-9e38-61acf4be9ac6 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-volume_attachments/86df490d-f1e9-4814-83ab-c26d1315a79c" status: 202 len: 0 microversion: 2.20 time: 0.271518 Oct 17 07:09:58.941230 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 504/1017] 10.222.0.36 () {60 vars in 1457 bytes} [Mon Oct 17 07:09:58 2022] DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-volume_attachments/86df490d-f1e9-4814-83ab-c26d1315a79c => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:09:59.002973 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:09:59.003584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:59.010014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:59.010793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:59.018751 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:59.019619 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:59.020076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:59.020505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:59.052490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118995) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 07:09:59.096487 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:09:59.125588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c3e18e3f-9cb8-420f-b65e-88d5493cc624 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "POST /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/action" status: 202 len: 0 microversion: 2.20 time: 0.126671 Oct 17 07:09:59.126232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 514/1018] 10.222.0.36 () {62 vars in 1319 bytes} [Mon Oct 17 07:09:58 2022] POST /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:09:59.134322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:59.134936 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:59.140799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:59.141284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:59.141716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:59.142404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:59.142858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:59.143317 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:59.283048 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:59.291261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:59.292716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:09:59.293873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9da489e4-e709-450c-aa62-427e4085a83e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1668 microversion: 2.20 time: 0.163506 Oct 17 07:09:59.294430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 505/1019] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:09:59 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:09:59.901779 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:09:59.902505 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:09:59.908737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:59.909233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:59.909678 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:09:59.910379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:09:59.910967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:09:59.911437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:00.321785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:00.323117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:00.323262 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:00.333349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:00.334283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:00.335670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:00.336582 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:00.337397 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:00.338027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:00.338496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f28c0da3-7586-43c9-9aa3-ac73516fdd2d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.440713 Oct 17 07:10:00.352075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 515/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:09:59 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:00.497676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:00.507408 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:00.508875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:00.510088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e1ac84a9-4812-4e74-abca-bcd53d81ad6a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1670 microversion: 2.20 time: 0.194177 Oct 17 07:10:00.510648 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 506/1021] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:00 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:01.363775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:01.364529 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:01.371643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:01.372069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:01.372545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:01.373246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:01.373704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:01.374157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:01.540236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:01.540853 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:01.550005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:01.550579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:01.551075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:01.551892 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:01.552405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:01.553015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:01.564291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:01.573764 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-66daa22f-23b5-43ea-a932-697377cbe7b2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.213823 Oct 17 07:10:01.574473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 516/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:01 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:01.692420 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:01.701546 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:01.702989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:01.704188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-15bcde86-8b7f-41c4-8ee7-bde1fe49db5b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.169546 Oct 17 07:10:01.704753 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 507/1023] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:01 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:02.056110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-03b748fb-c68e-4a67-a6f2-daa4a737af55 req-03b90b84-0c5e-401b-9c23-60d506a26a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "name": "network-vif-plugged", "status": "completed", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:02.061156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:02.067177 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-03b748fb-c68e-4a67-a6f2-daa4a737af55 req-03b90b84-0c5e-401b-9c23-60d506a26a1b service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:02.067745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-03b748fb-c68e-4a67-a6f2-daa4a737af55 req-03b90b84-0c5e-401b-9c23-60d506a26a1b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:02.068239 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-03b748fb-c68e-4a67-a6f2-daa4a737af55 req-03b90b84-0c5e-401b-9c23-60d506a26a1b service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:02.114883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-03b748fb-c68e-4a67-a6f2-daa4a737af55 req-03b90b84-0c5e-401b-9c23-60d506a26a1b service nova] Creating event network-vif-plugged:e3bd85c0-a0fd-4b86-940e-1ba4d645601f for instance c06f20c4-d1f2-4a52-95de-dae8c232c555 on hv-cinder-84506 Oct 17 07:10:02.129074 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-03b748fb-c68e-4a67-a6f2-daa4a737af55 req-03b90b84-0c5e-401b-9c23-60d506a26a1b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069801 Oct 17 07:10:02.130029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 517/1024] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:02.598333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:02.599900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:02.607687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:02.608519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:02.609117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:02.610405 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:02.611018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:02.611645 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:02.733655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:02.735053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:02.743706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:02.744482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:02.745090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:02.746161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:02.746701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:02.747382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:02.769966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:02.777613 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a0131384-c98f-4af3-baa3-efefb0c62d82 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.183498 Oct 17 07:10:02.778196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 508/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:02 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:02.902608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:02.914537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:02.916643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:02.918665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ad571beb-b26f-4c3e-93a5-4f335082475e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.191194 Oct 17 07:10:02.919625 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 518/1026] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:02 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:10:03.801047 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:03.801622 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:03.809755 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:03.810309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:03.810749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:03.811483 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:03.811942 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:03.812409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:03.945410 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:03.946120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:03.953494 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:03.954160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:03.954723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:03.955776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:03.956424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:03.957083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:03.968996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:03.993922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f32f3fdd-a3c4-4262-b656-c399f1a221ef tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.195464 Oct 17 07:10:03.995155 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 509/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:03 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:04.160122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:04.168896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:04.170346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:04.171548 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7b33f92f-5f15-4d99-8570-cd61df67ba84 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.230626 Oct 17 07:10:04.172100 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 519/1028] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:03 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:10:05.017827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:05.018406 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:05.025289 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:05.025774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:05.026208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:05.026910 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:05.027390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:05.027814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:05.181180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:05.189069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a82fb080-6caa-4a61-b55b-0131ffce28f1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.175209 Oct 17 07:10:05.189641 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 510/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:05 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:05.202098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:05.202811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:05.210382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:05.211356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:05.212075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:05.213156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:05.213895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:05.214341 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:05.359805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:05.368118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:05.369793 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:05.370956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ee0d58df-c9d5-46e7-b5db-5bfe416d4ee7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.177837 Oct 17 07:10:05.371767 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 520/1030] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:05 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:06.213941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:06.214556 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:06.221544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:06.222032 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:06.222687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:06.223445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:06.223902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:06.224324 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:06.361792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:06.370204 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-609b1368-37c8-4a73-a37d-5af2493c239a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.160695 Oct 17 07:10:06.370788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 511/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:06 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:06.398563 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:06.399267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:06.406124 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:06.406538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:06.406974 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:06.407702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:06.408327 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:06.408755 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:06.542424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:06.550771 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:06.552322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:06.553717 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4f55fd9c-58c0-4480-8f7c-e9a6b714df0a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.160364 Oct 17 07:10:06.562487 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 521/1032] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:06 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:07.394383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:07.395075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:07.405414 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:07.406170 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:07.406600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:07.407459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:07.408075 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:07.408495 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:07.552972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:07.561651 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5f2cef3d-c7de-436b-8dce-1d3bfd1b35bc tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.171512 Oct 17 07:10:07.562225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 512/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:07 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:10:07.581323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:07.581934 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:07.588606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:07.589090 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:07.589527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:07.590220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:07.590680 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:07.591103 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:07.726449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:07.734671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:07.736145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:07.737339 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a22bc8fb-5c4b-4360-8b31-95660ce25814 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.159955 Oct 17 07:10:07.737900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 522/1034] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:07 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:10:08.585455 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:08.586055 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:08.593027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:08.593512 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:08.594160 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:08.595022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:08.595664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:08.596248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:08.737985 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:08.746655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-272f25f3-0194-4dd6-bc04-67d8ece201d8 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.165254 Oct 17 07:10:08.747242 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 513/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:08 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:08.763058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:08.763752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:08.770178 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:08.770900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:08.771378 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:08.772123 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:08.772579 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:08.773182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:08.913965 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:08.922282 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:08.923821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:08.925131 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6cfb87a5-f39f-4af2-8b65-e79352282052 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.165953 Oct 17 07:10:08.925754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 523/1036] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:08 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:09.771264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:09.772974 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:09.780180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:09.780853 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:09.781287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:09.781981 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:09.782429 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:09.782842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:09.923398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:09.932064 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bb60608a-be34-4a1a-b12b-36a9cd12302a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.166227 Oct 17 07:10:09.932626 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 514/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:09 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:09.952223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:09.952844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:09.959283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:09.959780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:09.960220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:09.960925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:09.961384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:09.961808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:10.119418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:10.129718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:10.132573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:10.133959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3534eb7e-3288-47c3-bead-6d8769981b4e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.185940 Oct 17 07:10:10.135006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 524/1038] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:09 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:10.955813 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:10.956357 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:10.958817 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=58 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:10.963987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:10.964460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:10.964882 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:10.965553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:10.965998 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:10.966412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:10.970425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:11.097506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:11.106124 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1cb4ad30-09f2-4e30-97fa-6a47f02db44b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.154262 Oct 17 07:10:11.106679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 515/1039] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:10 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:11.160284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:11.160896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:11.167904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:11.168387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:11.168821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:11.169504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:11.169954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:11.170374 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:11.300553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:11.308662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:11.310095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:11.311268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-25bc97f2-4be0-4d0e-9f23-097f638738a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.154890 Oct 17 07:10:11.311823 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 525/1040] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:11 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:12.128767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:12.129315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:12.136387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:12.136865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:12.137293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:12.138040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:12.138489 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:12.138906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:12.267862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:12.275667 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b1dd1f48-2cf3-4b0a-b7c4-e63b6fb97415 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.150766 Oct 17 07:10:12.276237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 516/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:12 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:12.335851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:12.336464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:12.342996 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:12.343506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:12.343938 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:12.344617 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:12.345065 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:12.345482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:12.472588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:12.481190 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:12.482635 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:12.483834 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8ce486f7-3add-4e04-baf0-3a7c8de41dab tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.151849 Oct 17 07:10:12.484395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 526/1042] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:12 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:13.297928 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:13.298567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:13.305544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:13.306020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:13.306450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:13.307129 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:13.307620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:13.308043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:13.434392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:13.441952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bc2911f0-0f5b-4048-a3ee-750a27504ac7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.147906 Oct 17 07:10:13.442520 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 517/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:13 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:13.510370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:13.511021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:13.517904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:13.518393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:13.518838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:13.519557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:13.520808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:13.522195 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:13.649620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:13.657801 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:13.659271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:13.660435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5296f6f5-9b13-4b95-886e-20cbf6a8e17e tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.155344 Oct 17 07:10:13.660986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 527/1044] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:13 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:14.464236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:14.464841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:14.471919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:14.472400 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:14.472824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:14.473498 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:14.473940 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:14.474436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:14.497907 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:14.498393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:14.504295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:14.504770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:14.505198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:14.505879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:14.506916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:14.507371 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:14.530600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8e34cfbe-8de9-498c-b070-94d3c8fa7e8b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/ips" status: 200 len: 150 microversion: 2.1 time: 0.036461 Oct 17 07:10:14.531295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 528/1045] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:10:14 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:14.609481 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:14.617992 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9d65e100-ec09-4688-8190-579c3684e39e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.157579 Oct 17 07:10:14.618658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 518/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:14 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:14.687978 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:14.689049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:14.695150 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:14.695659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:14.696097 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:14.696782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:14.697234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:14.697661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:14.836023 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:14.844497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:14.845925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:14.847075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-90a9b705-311f-4699-8191-57929a86be13 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.164751 Oct 17 07:10:14.847652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 529/1047] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:14 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:15.640210 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:15.640746 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:15.647649 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:15.648126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:15.648555 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:15.649237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:15.649683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:15.650100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:15.782750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:15.790384 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7a1412ef-8f10-48b5-8276-aa37b44b4e18 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.154151 Oct 17 07:10:15.790948 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 519/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:15 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:15.872622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:15.873224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:15.879744 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:15.880219 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:15.880644 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:15.881904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:15.882350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:15.882765 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:16.011267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:16.019397 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:16.020846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:16.022545 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-10b19e08-0eeb-47c1-976b-d9bf8fb018c7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.153773 Oct 17 07:10:16.023083 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 530/1049] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:15 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:16.813197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:16.813803 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:16.820906 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:16.821379 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:16.821809 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:16.822485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:16.822931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:16.823381 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:16.957389 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:16.965147 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-78e02529-5413-4253-95fc-6c999210c9e6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.155911 Oct 17 07:10:16.965704 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 520/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:16 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:17.047997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:17.048610 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:17.055651 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:17.056139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:17.056574 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:17.057273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:17.057729 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:17.058157 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:17.185538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:17.193672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:17.195114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:17.196300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6661bde8-8919-4977-bcaf-165ecb04b447 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.152189 Oct 17 07:10:17.196852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 531/1051] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:17 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:17.987709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:17.988315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:17.995149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:17.995662 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:17.996098 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:17.996786 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:17.997243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:17.997668 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:18.127180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:18.135413 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-98870e1d-0638-4126-b046-fb755a57d5b7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.151515 Oct 17 07:10:18.135979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 521/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:17 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:18.221474 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:18.222079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:18.228467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:18.228941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:18.229402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:18.230082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:18.230530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:18.230954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:18.234909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:18.359117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:18.368343 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:18.369778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:18.370940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d68854b9-09cb-49ef-9dd8-24d330a583c1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.153722 Oct 17 07:10:18.371519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 532/1053] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:18 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:19.157987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:19.158605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:19.165054 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:19.165531 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:19.165957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:19.166640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:19.167091 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:19.167543 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:19.294294 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:19.301953 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9483fb50-9c3b-4220-a382-a0af95258d0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.147955 Oct 17 07:10:19.302531 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 522/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:19 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:19.397163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:19.397806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:19.404175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:19.404657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:19.405095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:19.405781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:19.406235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:19.406659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:19.534962 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:19.543141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:19.544607 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:19.545758 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dab04163-f9d8-47dc-8baf-7bceeb19df90 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.153185 Oct 17 07:10:19.546314 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 533/1055] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:19 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:20.324486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:20.325026 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:20.331634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:20.332114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:20.332548 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:20.333232 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:20.333685 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:20.334604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:20.462209 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:20.469783 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-cae461ee-94f0-4740-8609-f64bfd91cc0a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.149287 Oct 17 07:10:20.470353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 523/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:20 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:20.571821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:20.572441 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:20.578891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:20.579354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:20.579795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:20.580485 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:20.580943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:20.581368 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:20.707110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:20.715704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:20.717132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:20.718281 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cc54ffb1-16e3-41ba-8621-f5811a2127a2 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.150346 Oct 17 07:10:20.718837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 534/1057] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:20 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:21.493540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:21.494151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:21.500565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:21.501045 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:21.501475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:21.502157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:21.502606 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:21.503025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:21.632738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:21.640418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d7987abf-b49f-455f-a5d1-56513d87df35 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.151495 Oct 17 07:10:21.640983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 524/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:21 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:21.743615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:21.744205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:21.750589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:21.751077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:21.751552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:21.752244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:21.752702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:21.753131 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:21.879500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:21.888081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:21.889520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:21.890676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c6cbb23b-bd78-415c-a275-5b2b4fd48361 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.151814 Oct 17 07:10:21.891243 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 535/1059] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:21 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:22.662656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:22.663296 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:22.669805 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:22.670282 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:22.670713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:22.671430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:22.671883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:22.672303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:22.801623 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:22.809196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5477dbc1-8bfd-4f24-ba56-7e3131515de6 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.151020 Oct 17 07:10:22.809765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 525/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:22 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:22.915725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:22.916278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:22.922683 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:22.923163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:22.923708 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:22.924395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:22.924850 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:22.925270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:23.052411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:23.060701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:23.062238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:23.063478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f34fa911-eedb-45ff-8ccd-bb1cf62bcb0b tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.151606 Oct 17 07:10:23.064049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 536/1061] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:22 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:23.832060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:23.832709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:23.839707 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:23.840198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:23.840634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:23.841322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:23.841776 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:23.842201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:23.974149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:23.981814 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-27bfd1c1-2d23-4ec3-acd8-c9ca758946be tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.153633 Oct 17 07:10:23.982412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 526/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:23 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:24.089557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:24.090072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:24.096456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:24.096940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:24.097372 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:24.098056 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:24.098512 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:24.098942 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:24.234094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:24.249795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:24.252698 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:24.254856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1f536801-4076-4f72-a29f-ff142b4279ec tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.169088 Oct 17 07:10:24.256544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 537/1063] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:24 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:25.005149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:25.006378 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:25.012810 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:25.013293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:25.013734 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:25.014424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:25.014881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:25.015342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:25.140043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:25.147957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-42a93424-abcb-49c2-9163-f4e69c796cd2 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.146689 Oct 17 07:10:25.148618 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 527/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:25 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:25.296845 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:25.297454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:25.304483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:25.304965 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:25.305394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:25.306077 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:25.306526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:25.306940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:25.350808 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba6256f7-9d7e-4a22-be23-e8ad33e8d8f6"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:25.353255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:25.359058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:25.359578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:25.360009 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:25.360705 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:25.361156 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:25.361579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:25.435068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:25.444774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:25.446238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:25.447433 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b8e9f29f-e494-472f-b645-489741bdcb78 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.154479 Oct 17 07:10:25.447986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 538/1065] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:25 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:10:25.743485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2889b3be-633c-4f73-b227-27d0654c645b tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "POST /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396563 Oct 17 07:10:25.744198 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 528/1066] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:10:25 2022] POST /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:10:26.171308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:26.172011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:26.178310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.178899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.179454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.180210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.180679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.181112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.320185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:26.328008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-25007277-f520-419c-905e-ed64b9480e1a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1259 microversion: 2.1 time: 0.160695 Oct 17 07:10:26.328566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 539/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:26 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:26.402789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:26.405229 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:26.412173 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.412648 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.413077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.413771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.414220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.414633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.444590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3dc6adb5-72d6-4b98-a989-c5db7befa5c7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Oct 17 07:10:26.445143 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 529/1068] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:26 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:26.456039 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:26.456529 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:26.462411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.462899 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.463364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.464053 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.464518 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.464923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.474342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:26.475958 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:26.483239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.483858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.484274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.485082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:26.485559 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:26.485988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:26.497370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-103b0479-cdd8-43c5-9270-55bcaabf2fb5 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/46467dc3-a8d7-4cc3-98c0-cca382aa7807" status: 200 len: 194 microversion: 2.1 time: 0.045132 Oct 17 07:10:26.499364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 540/1069] 10.222.0.36 () {58 vars in 1413 bytes} [Mon Oct 17 07:10:26 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/46467dc3-a8d7-4cc3-98c0-cca382aa7807 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:26.507547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:26.664554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:26.674892 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:26.676916 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:26.679576 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-de8b590a-ff7d-47ed-9b21-7757b44de7ba tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.209074 Oct 17 07:10:26.692070 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 530/1070] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:26 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 07:10:27.351001 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:27.351822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:27.358603 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.359166 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.359677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.360367 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.360818 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.361241 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.493092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:27.500789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-966eea42-7fb4-4cbe-be4f-75cdf18f299c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1442 microversion: 2.1 time: 0.153801 Oct 17 07:10:27.501350 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 541/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:27 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:27.525295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:27.526641 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:27.533552 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.534072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.534539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.535260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.535717 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.536139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.672519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:27.680855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b4ada169-bd2a-4e4b-8042-1db4cbe4e660 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1442 microversion: 2.1 time: 0.160194 Oct 17 07:10:27.681427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 531/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:27 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:27.707549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:27.708247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:27.714640 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.715243 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.715742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.716514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.717042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.717696 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.882320 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b440c90c-197c-4500-b324-be602302f04d"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:27.884574 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:27.885030 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:27.891284 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.891895 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.892654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.893020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:27.893357 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:27.893914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:27.894636 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:27.894770 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:27.895728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-783e7eb8-c7b0-4b3f-b8ff-a7682924a0b7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.192221 Oct 17 07:10:27.896946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 542/1073] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:27 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:28.182642 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-e04b28c5-53c5-44fe-bcdd-343a24033e71 req-ae012fa7-7aaf-4abe-a828-8aef086ec12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "name": "network-vif-plugged", "status": "completed", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:28.197006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e04b28c5-53c5-44fe-bcdd-343a24033e71 req-ae012fa7-7aaf-4abe-a828-8aef086ec12c service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:28.197792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e04b28c5-53c5-44fe-bcdd-343a24033e71 req-ae012fa7-7aaf-4abe-a828-8aef086ec12c service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:28.198380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e04b28c5-53c5-44fe-bcdd-343a24033e71 req-ae012fa7-7aaf-4abe-a828-8aef086ec12c service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:28.212181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-e04b28c5-53c5-44fe-bcdd-343a24033e71 req-ae012fa7-7aaf-4abe-a828-8aef086ec12c service nova] Creating event network-vif-plugged:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:10:28.223200 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-e04b28c5-53c5-44fe-bcdd-343a24033e71 req-ae012fa7-7aaf-4abe-a828-8aef086ec12c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046240 Oct 17 07:10:28.225107 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 543/1074] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:28.315485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c3a3fe4d-14e5-4e2e-a36f-f660b6a882e7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "POST /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437801 Oct 17 07:10:28.316391 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 532/1075] 10.222.0.36 () {60 vars in 1323 bytes} [Mon Oct 17 07:10:27 2022] POST /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:10:28.922832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:28.923638 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:28.929795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:28.930273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:28.930702 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:28.931418 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:28.931866 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:28.932285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:29.079027 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:29.087909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:29.089351 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:29.090510 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-68538965-2cd0-48b2-bcfa-1121444f3866 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.172383 Oct 17 07:10:29.091069 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 544/1076] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:28 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:29.796304 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-e34acb36-f825-497e-9fc9-72b9db775ef8 req-574deb68-77cd-4050-9483-4772fcb4caa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:29.808624 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e34acb36-f825-497e-9fc9-72b9db775ef8 req-574deb68-77cd-4050-9483-4772fcb4caa1 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:29.809099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e34acb36-f825-497e-9fc9-72b9db775ef8 req-574deb68-77cd-4050-9483-4772fcb4caa1 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:29.809522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-e34acb36-f825-497e-9fc9-72b9db775ef8 req-574deb68-77cd-4050-9483-4772fcb4caa1 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:29.824778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-e34acb36-f825-497e-9fc9-72b9db775ef8 req-574deb68-77cd-4050-9483-4772fcb4caa1 service nova] Creating event network-changed:e3bd85c0-a0fd-4b86-940e-1ba4d645601f for instance c06f20c4-d1f2-4a52-95de-dae8c232c555 on hv-cinder-84506 Oct 17 07:10:29.830428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-e34acb36-f825-497e-9fc9-72b9db775ef8 req-574deb68-77cd-4050-9483-4772fcb4caa1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039010 Oct 17 07:10:29.831309 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 533/1077] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:30.117492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:30.118320 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:30.125599 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:30.126240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:30.126782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:30.127649 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:30.128215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:30.128772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:30.371795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:30.381334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:30.384506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:30.387273 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-64e878a2-076b-4d54-9597-1aaf42ea3b8d tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1726 microversion: 2.20 time: 0.273480 Oct 17 07:10:30.391247 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 545/1078] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:30 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:31.414885 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:31.415621 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:31.421747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:31.422221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:31.422652 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:31.423373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:31.423827 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:31.424247 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:31.552303 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:31.560437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:31.561877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:31.563113 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a0ef8554-d19a-4899-9e69-0ffc2cbbd8be tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1713 microversion: 2.20 time: 0.153522 Oct 17 07:10:31.563837 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 534/1079] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:10:31 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:10:38.721565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:38.722038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:38.724469 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=58 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:38.730496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:38.730977 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:38.731448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:38.732128 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:38.732618 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:38.733038 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:38.811929 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lazy-loading 'services' on Instance uuid eba3dff1-3b70-45d9-9f95-34e825c3601a {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:10:38.881174 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d444a58e-9463-472f-9530-1544aa46dff0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments/ba6256f7-9d7e-4a22-be23-e8ad33e8d8f6" status: 202 len: 0 microversion: 2.1 time: 0.163221 Oct 17 07:10:38.881662 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 546/1080] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:10:38 2022] DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments/ba6256f7-9d7e-4a22-be23-e8ad33e8d8f6 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:10:38.890005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:38.892369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:38.898891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:38.899451 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:38.899809 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:38.900502 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:38.900952 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:38.901372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:38.932043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-99f59e1c-1f13-4703-a99f-d1f1a2c4416f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Oct 17 07:10:38.932812 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 535/1081] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:38 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:39.946900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:39.949250 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:39.955692 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:39.956175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:39.956606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:39.957289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:39.957742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:39.958167 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:39.988294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-80e2607b-3bc9-42f5-bccf-9c6cf785fdc6 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Oct 17 07:10:39.988772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 547/1082] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:39 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:41.000832 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:41.002990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:41.005450 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=42 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:41.010657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:41.011131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:41.011587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:41.012270 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:41.012720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:41.013139 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:41.042474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9bab357e-3d77-4a88-a15d-74ea6d2c4069 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Oct 17 07:10:41.043025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 536/1083] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:40 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:42.055554 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:42.057763 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:42.063925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:42.064411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:42.064849 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:42.065535 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:42.065993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:42.066421 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:42.091647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:42.096961 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3c6e00d6-d43c-4e6f-bf09-3e3906c749b2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Oct 17 07:10:42.097502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 548/1084] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:42 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:43.108849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:43.111056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:43.118056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:43.118532 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:43.118965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:43.119682 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:43.120136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:43.120559 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:43.149743 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-03531b98-f027-4d59-affe-9c0dc5a83db1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Oct 17 07:10:43.150310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 537/1085] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:43 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:44.162018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:44.164217 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:44.171328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:44.171805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:44.172234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:44.172917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:44.173375 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:44.173781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:44.202802 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-48f95a42-1f24-45c6-b690-b50cb778065d tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Oct 17 07:10:44.203364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 549/1086] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:44 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:45.215957 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:45.218119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:45.225112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:45.225590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:45.226040 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:45.226717 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:45.227186 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:45.227720 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:45.256514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-3b40e984-45cb-4c32-9a0f-ec1cbbb0255e tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Oct 17 07:10:45.257067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 538/1087] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:45 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:46.269122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:46.271489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:46.277915 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.278400 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.278841 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.279568 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.280028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.280458 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.316878 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5cb700ff-7487-47fb-94d3-9022ada5c674 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051864 Oct 17 07:10:46.317645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 550/1088] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:46 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:46.463503 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:46.465666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:46.471966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.472447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.472880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.473563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.474015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.474437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.504219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e0f5aed7-5067-422e-a3da-85f6bb59004e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045216 Oct 17 07:10:46.504781 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 539/1089] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:46 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:46.641061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:46.641553 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:46.648049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.648536 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.648998 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.649685 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.650182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.650614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.679993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-03d35c76-30b4-4c91-a5ff-f8551b6394f8 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/46467dc3-a8d7-4cc3-98c0-cca382aa7807" status: 200 len: 194 microversion: 2.1 time: 0.042891 Oct 17 07:10:46.680489 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 551/1090] 10.222.0.36 () {58 vars in 1413 bytes} [Mon Oct 17 07:10:46 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/46467dc3-a8d7-4cc3-98c0-cca382aa7807 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:46.690989 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:46.691507 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:46.697425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.697907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.698343 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.699060 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:46.699540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:46.699966 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:46.779073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lazy-loading 'services' on Instance uuid 44cad347-b818-4dc8-b9ab-26e38b5edf8e {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:10:46.850708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-61956db9-45a1-4a15-8b17-a41c286bcaad tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/46467dc3-a8d7-4cc3-98c0-cca382aa7807" status: 202 len: 0 microversion: 2.1 time: 0.163478 Oct 17 07:10:46.851327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 540/1091] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:10:46 2022] DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/46467dc3-a8d7-4cc3-98c0-cca382aa7807 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:10:47.329964 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:47.332094 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:47.338452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:47.338940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:47.339425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:47.340120 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:47.340576 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:47.341005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:47.369198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aa38a9b6-72cb-42db-a2a9-66fd1c4fd7d1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043591 Oct 17 07:10:47.369748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 552/1092] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:47 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:10:47.434219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:47.434803 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:47.440865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:47.441337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:47.441763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:47.442435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:47.442884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:47.443320 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:47.468600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:10:47.541937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1d3d0b55-6a6e-47e6-a010-3f402fe27fb5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 204 len: 0 microversion: 2.1 time: 0.112260 Oct 17 07:10:47.542522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 541/1093] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:10:47 2022] DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:10:47.550526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:47.551135 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:47.557667 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:47.558146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:47.558577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:47.559283 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:47.559737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:47.560161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:47.686145 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:47.693772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0ee0b1d-1b58-4a56-af84-d40fdedba2b0 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1682 microversion: 2.1 time: 0.147040 Oct 17 07:10:47.694328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 553/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:47 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:10:48.717879 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:48.718574 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:48.724880 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:48.725353 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:48.725782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:48.726459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:48.726902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:48.727350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:48.857257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:48.864893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-175bb76d-6a1a-465b-94a9-a562862dd1c1 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1682 microversion: 2.1 time: 0.151316 Oct 17 07:10:48.865464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 542/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:48 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:49.889192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:49.889902 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:49.896808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:49.897295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:49.897726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:49.898451 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:49.898908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:49.899355 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:50.088240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:50.088807 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:50.095657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:50.096149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:50.096585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:50.097299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:50.097829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:50.098179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:50.127328 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6b268e6d-3421-48b5-ba58-2e6a1befc4b7 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/b440c90c-197c-4500-b324-be602302f04d" status: 200 len: 194 microversion: 2.1 time: 0.043758 Oct 17 07:10:50.127935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 543/1096] 10.222.0.36 () {58 vars in 1413 bytes} [Mon Oct 17 07:10:50 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/b440c90c-197c-4500-b324-be602302f04d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:10:50.139369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:50.139876 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:50.145741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:50.146225 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:50.146659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:50.147384 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:50.147839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:50.148263 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:50.151677 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:10:50.242694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lazy-loading 'services' on Instance uuid 44cad347-b818-4dc8-b9ab-26e38b5edf8e {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:10:50.301370 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:50.309744 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5628b42a-36b8-4ad6-8fcc-5d2483f7d91f tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1682 microversion: 2.1 time: 0.424424 Oct 17 07:10:50.327828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 554/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:49 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1682 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:50.329360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a75f052d-d738-4e93-9972-9c17e35dfa3e tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/b440c90c-197c-4500-b324-be602302f04d" status: 202 len: 0 microversion: 2.1 time: 0.193799 Oct 17 07:10:50.330094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 544/1098] 10.222.0.36 () {58 vars in 1416 bytes} [Mon Oct 17 07:10:50 2022] DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments/b440c90c-197c-4500-b324-be602302f04d => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:10:50.859783 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-fd4af217-16df-4f53-8c2f-828332b44b49 req-dc238231-2273-4afd-ac3a-218e052fe612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba3dff1-3b70-45d9-9f95-34e825c3601a", "name": "network-vif-deleted", "tag": "182f3c3c-a2a4-4cf7-a91e-f07cd76ea450"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:50.876732 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fd4af217-16df-4f53-8c2f-828332b44b49 req-dc238231-2273-4afd-ac3a-218e052fe612 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:50.877648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fd4af217-16df-4f53-8c2f-828332b44b49 req-dc238231-2273-4afd-ac3a-218e052fe612 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:50.878169 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fd4af217-16df-4f53-8c2f-828332b44b49 req-dc238231-2273-4afd-ac3a-218e052fe612 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:50.889488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-fd4af217-16df-4f53-8c2f-828332b44b49 req-dc238231-2273-4afd-ac3a-218e052fe612 service nova] Creating event network-vif-deleted:182f3c3c-a2a4-4cf7-a91e-f07cd76ea450 for instance eba3dff1-3b70-45d9-9f95-34e825c3601a on hv-cinder-84506 Oct 17 07:10:50.894604 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-fd4af217-16df-4f53-8c2f-828332b44b49 req-dc238231-2273-4afd-ac3a-218e052fe612 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038469 Oct 17 07:10:50.895198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 555/1099] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:51.335399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:51.336109 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:51.342479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:51.343059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:51.343521 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:51.344218 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:51.344675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:51.345101 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:51.377073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:51.377554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:51.377993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:51.378447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lazy-loading 'fault' on Instance uuid eba3dff1-3b70-45d9-9f95-34e825c3601a {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:10:51.419897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e37d9ed3751483ebe4141706f46e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934764e1a1394bfb91688060b594a58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:51.428278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fe05b499-11ad-4fa1-9d9e-c56c14aad621 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 200 len: 1331 microversion: 2.1 time: 0.097764 Oct 17 07:10:51.428925 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 545/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:51 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:51.514096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:51.516365 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:51.522387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:51.522872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:51.523328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:51.524018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:51.524466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:51.524891 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:51.554790 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-99acc312-6c09-4fa8-9ca8-e6dfcf21efa6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044881 Oct 17 07:10:51.555373 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 556/1101] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:51 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:52.452856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:52.453471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:52.459884 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.460363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.460797 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.461483 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.461980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.462409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.475368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a HTTP/1.1 Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:52.476979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:52.478597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'eba3dff1-3b70-45d9-9f95-34e825c3601a'} Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:52.479562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:52.481103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:52.482412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:52.482412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-122581fd-32f3-4ead-83a1-adb001568ca5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 404 len: 111 microversion: 2.1 time: 0.029638 Oct 17 07:10:52.482412 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 546/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:52 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:10:52.487266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-36a352b3-bede-49a1-a456-d18a86bde3f3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '.version_select at 0x7f4acd22ff70>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:52.505905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-36a352b3-bede-49a1-a456-d18a86bde3f3 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747511651" status: 202 len: 0 microversion: 2.1 time: 0.022541 Oct 17 07:10:52.506446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 557/1103] 10.222.0.36 () {58 vars in 1221 bytes} [Mon Oct 17 07:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747511651 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:10:52.568089 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:52.570409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:52.577285 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.577747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.578179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.578871 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.579369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.579851 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.608346 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ca0a35a1-f7be-43c1-aa75-6d3dee9abded tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044166 Oct 17 07:10:52.608902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 547/1104] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:52 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 07:10:52.731301 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:52.733578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:52.740559 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.741118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.741626 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.742387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.742915 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.743955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.774081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8dab1ace-b255-45d6-a491-d689867ee319 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046896 Oct 17 07:10:52.774925 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 558/1105] 10.222.0.36 () {58 vars in 1302 bytes} [Mon Oct 17 07:10:52 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 07:10:52.838535 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:52.839024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:52.844843 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.845319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.845744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.846426 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.846875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.847319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.872914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:10:52.952266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-2a02a21c-c0ea-45fc-9b4b-da80391c07bb tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 204 len: 0 microversion: 2.1 time: 0.117183 Oct 17 07:10:52.953131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 548/1106] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:10:52 2022] DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:10:52.962268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:52.962819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:52.968795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.969284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.969715 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:52.970407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:52.970862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:52.971379 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:53.179566 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:53.193839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f81b9e83-c7c3-4f78-9963-c254c4f2104a tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1674 microversion: 2.1 time: 0.236029 Oct 17 07:10:53.194449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 559/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:52 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:54.220104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:54.220799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:54.227077 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:54.227587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:54.228019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:54.228697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:54.229143 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:54.229557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:54.362587 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:54.365244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:54.365740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:54.371008 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e63d5e43-ca31-4290-8589-1e00064628ff tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1674 microversion: 2.1 time: 0.155169 Oct 17 07:10:54.371598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 549/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:54 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:54.373653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:54.374205 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:54.374644 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:54.375369 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:54.375823 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:54.376246 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:54.389583 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a HTTP/1.1 Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:10:54.391257 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.392867 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'eba3dff1-3b70-45d9-9f95-34e825c3601a'} Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:54.393769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.395347 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.396848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:54.396848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b637101f-ac3d-4a54-9055-f02f97ef2564 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 404 len: 111 microversion: 2.1 time: 0.031190 Oct 17 07:10:54.396848 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 560/1109] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:10:54 2022] DELETE /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:54.401196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:54.401800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: eba3dff1-3b70-45d9-9f95-34e825c3601a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:54.407763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:54.408185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:54.408609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:54.409292 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:54.409736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:54.410150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:54.423633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a HTTP/1.1 Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:54.425233 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.426847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'eba3dff1-3b70-45d9-9f95-34e825c3601a'} Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:54.427673 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. Oct 17 07:10:54.428930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:54.430022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance eba3dff1-3b70-45d9-9f95-34e825c3601a could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:54.430022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ca9d4d28-fe6f-4f7f-99d5-347ed0112a61 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a" status: 404 len: 111 microversion: 2.1 time: 0.029198 Oct 17 07:10:54.430022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 550/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:54 2022] GET /compute/v2.1/servers/eba3dff1-3b70-45d9-9f95-34e825c3601a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:55.393861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:55.394460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:55.400920 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.401413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.401832 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.402511 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.402960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.403406 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.568179 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:55.568744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:55.575995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.576473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.576900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.577592 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.578052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.578472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.591855 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 HTTP/1.1 Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:55.593390 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.594983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '6c2bcdbd-c141-4c72-b7ac-60134fe19975'} Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:55.596127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.597383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.599561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:55.599561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-31f60312-1f9b-408b-ae84-59d2332650f9 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 404 len: 111 microversion: 2.1 time: 0.030508 Oct 17 07:10:55.599561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 551/1111] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:10:55 2022] DELETE /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:10:55.602867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:55.603493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: 6c2bcdbd-c141-4c72-b7ac-60134fe19975] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:55.609258 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.609736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.610167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.610857 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.611342 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.611761 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.625522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 HTTP/1.1 Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:55.627024 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.629352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '6c2bcdbd-c141-4c72-b7ac-60134fe19975'} Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:55.630120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. Oct 17 07:10:55.631468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.632567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance 6c2bcdbd-c141-4c72-b7ac-60134fe19975 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:55.632567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-062ad97a-052e-417c-b0c3-b289fb7010f2 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975" status: 404 len: 111 microversion: 2.1 time: 0.029081 Oct 17 07:10:55.632567 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 552/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:55 2022] GET /compute/v2.1/servers/6c2bcdbd-c141-4c72-b7ac-60134fe19975 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:55.637392 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:55.637934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:55.643983 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.644460 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.644887 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.645579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.646027 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.646445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.652983 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:55.661058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8adae7b2-06c1-43b6-8191-b9414e0a6b5b tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1674 microversion: 2.1 time: 0.271006 Oct 17 07:10:55.661805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 561/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:55 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:55.666331 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 HTTP/1.1 Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:55.667978 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.669355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'abb0d772-1540-4f77-8bbd-04827935fee4'} Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:55.670127 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.672244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.674044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:55.674044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f9fb500c-965b-4654-b433-8a1680a74604 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 404 len: 111 microversion: 2.1 time: 0.036290 Oct 17 07:10:55.674044 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 553/1114] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:10:55 2022] DELETE /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:55.677879 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:55.678519 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: abb0d772-1540-4f77-8bbd-04827935fee4] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:55.684881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.685364 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.685797 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.686484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:55.686933 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:55.687385 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:55.701189 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 HTTP/1.1 Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:10:55.702739 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.704356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'abb0d772-1540-4f77-8bbd-04827935fee4'} Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:55.705222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. Oct 17 07:10:55.706652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:55.708005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance abb0d772-1540-4f77-8bbd-04827935fee4 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:55.708005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e65ac4a3-2207-4035-933b-7981290f65b5 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4" status: 404 len: 111 microversion: 2.1 time: 0.030089 Oct 17 07:10:55.708005 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 562/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:55 2022] GET /compute/v2.1/servers/abb0d772-1540-4f77-8bbd-04827935fee4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:10:56.101029 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-04f69c4b-ef6e-4dd5-8c7d-6ad6224096ce req-4a6f61bd-08b4-4472-85ac-be64ea8fa2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cad347-b818-4dc8-b9ab-26e38b5edf8e", "name": "network-vif-deleted", "tag": "822458de-2d1e-4246-a342-8e13c6f3ed71"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:10:56.111395 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-04f69c4b-ef6e-4dd5-8c7d-6ad6224096ce req-4a6f61bd-08b4-4472-85ac-be64ea8fa2b6 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.111867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-04f69c4b-ef6e-4dd5-8c7d-6ad6224096ce req-4a6f61bd-08b4-4472-85ac-be64ea8fa2b6 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.112296 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-04f69c4b-ef6e-4dd5-8c7d-6ad6224096ce req-4a6f61bd-08b4-4472-85ac-be64ea8fa2b6 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.124241 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-04f69c4b-ef6e-4dd5-8c7d-6ad6224096ce req-4a6f61bd-08b4-4472-85ac-be64ea8fa2b6 service nova] Creating event network-vif-deleted:822458de-2d1e-4246-a342-8e13c6f3ed71 for instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e on hv-cinder-84506 Oct 17 07:10:56.130816 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-04f69c4b-ef6e-4dd5-8c7d-6ad6224096ce req-4a6f61bd-08b4-4472-85ac-be64ea8fa2b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033400 Oct 17 07:10:56.131448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 554/1116] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:10:56.684344 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:56.685490 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:56.692105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.692592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.693021 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.693718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.694161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.694749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.736019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.736609 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.737018 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.737479 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lazy-loading 'fault' on Instance uuid 44cad347-b818-4dc8-b9ab-26e38b5edf8e {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:10:56.781600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b2f292cea24a21928e2adcef0c3786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f992a8ccca8d487abd91dc6d0baaf3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:10:56.789622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-73b1ca2a-f72f-4727-a7bb-781e34567d60 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 200 len: 1327 microversion: 2.1 time: 0.109087 Oct 17 07:10:56.799238 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 563/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:56 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:10:56.855878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:56.856463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:56.862959 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.863519 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.863954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.864683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.865164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.865616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.879692 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db HTTP/1.1 Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:56.881319 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.883001 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': 'e5ca5f24-f6d6-4847-a8b9-d6155ad652db'} Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:56.884033 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.886099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.887865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:56.887865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b1a74cb8-688d-4576-ac7a-d754a13b8409 tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 404 len: 111 microversion: 2.1 time: 0.031893 Oct 17 07:10:56.887865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 555/1118] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:10:56 2022] DELETE /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:56.891780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:56.892391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] [instance: e5ca5f24-f6d6-4847-a8b9-d6155ad652db] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:56.898556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.899043 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.899555 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.900348 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:56.900795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:56.901213 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:56.914947 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] HTTP exception thrown: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Request method failure captured: Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db HTTP/1.1 Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4wed435lKYQJFo1Ldbzx8ka-utHsADqZlwF2_J-xADFp1irRIy8jT7gIOiMaojTnwWmJuL7SLdMrxcIdjmXDE_Cla4iOCyuVYInfDgc2hbNxXQqUP53JprZhq2ajV_HOlDC0k_IWgQG6D7NCEwWBK28olhobjyXNlXb8--scySAUo Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:10:56.916589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/934764e1a1394bfb91688060b594a58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/934764e1a1394bfb91688060b594a58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_934764e1a1394bfb91688060b594a58a"}]}] Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 934764e1a1394bfb91688060b594a58a Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1263396803 Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 1e37d9ed3751483ebe4141706f46e43a Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1263396803-project Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.918272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'e5ca5f24-f6d6-4847-a8b9-d6155ad652db'} Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:56.919774 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. Oct 17 07:10:56.921276 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:10:56.922602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] Returning 404 to user: Instance e5ca5f24-f6d6-4847-a8b9-d6155ad652db could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:56.922602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7e3067af-fff0-4330-972c-e80b1029e21c tempest-AttachVolumeNegativeTest-1263396803 tempest-AttachVolumeNegativeTest-1263396803-project] 10.222.0.36 "GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db" status: 404 len: 111 microversion: 2.1 time: 0.030032 Oct 17 07:10:56.922602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 564/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:56 2022] GET /compute/v2.1/servers/e5ca5f24-f6d6-4847-a8b9-d6155ad652db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:57.814208 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:57.815019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:10:57.821937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:57.822430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:57.822883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:57.823607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:10:57.824099 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:10:57.824656 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:10:57.839043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] HTTP exception thrown: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Request method failure captured: Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e HTTP/1.1 Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4v6duY-JjrZHZbxsxLgB31jbTd9mxoms6wfxl0_GttHJ8QCB_2g9-e_75Vk33c6zdnwFhvk7KHijRS-1PB0FygJKzYAu3szN0G8NJm0Jb6ihb3lMTUz9wCUoUhrmhaH3tjuJZ9k2XSLuwTKUP3HNR65jewDyyhpHsWX4Gis0uwXBc Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:10:57.840593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f992a8ccca8d487abd91dc6d0baaf3bc"}]}] Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 51b2f292cea24a21928e2adcef0c3786 Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:10:57.842253 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '44cad347-b818-4dc8-b9ab-26e38b5edf8e'} Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:10:57.843062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:10:57.844333 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:10:57.845505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Returning 404 to user: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:10:57.845505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-024d1427-2e96-43b4-96cb-943d7d1119d6 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 404 len: 111 microversion: 2.1 time: 0.031879 Oct 17 07:10:57.845505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 556/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:10:57 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:10:57.850836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-abdba68d-6e49-48f0-9bba-a6dc6e6dfcae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '.version_select at 0x7f4acd197f70>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:10:57.871330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-abdba68d-6e49-48f0-9bba-a6dc6e6dfcae tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-456951943" status: 202 len: 0 microversion: 2.1 time: 0.024114 Oct 17 07:10:57.872112 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 565/1121] 10.222.0.36 () {58 vars in 1218 bytes} [Mon Oct 17 07:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-456951943 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:11:00.918723 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:00.919255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:00.925293 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:00.925770 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:00.926197 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:00.927022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:00.927336 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:00.927757 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:00.941934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] HTTP exception thrown: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Request method failure captured: Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e HTTP/1.1 Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4v6duY-JjrZHZbxsxLgB31jbTd9mxoms6wfxl0_GttHJ8QCB_2g9-e_75Vk33c6zdnwFhvk7KHijRS-1PB0FygJKzYAu3szN0G8NJm0Jb6ihb3lMTUz9wCUoUhrmhaH3tjuJZ9k2XSLuwTKUP3HNR65jewDyyhpHsWX4Gis0uwXBc Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:11:00.943457 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f992a8ccca8d487abd91dc6d0baaf3bc"}]}] Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 51b2f292cea24a21928e2adcef0c3786 Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.945151 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '44cad347-b818-4dc8-b9ab-26e38b5edf8e'} Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:00.946216 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.950031 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.952600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Returning 404 to user: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:00.952600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b4db6505-c88f-4ec4-a73a-9a567ba46226 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 404 len: 111 microversion: 2.1 time: 0.030336 Oct 17 07:11:00.952600 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 557/1122] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:11:00 2022] DELETE /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:00.956318 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:00.957738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 44cad347-b818-4dc8-b9ab-26e38b5edf8e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:00.965952 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:00.966669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:00.967330 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:00.968404 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:00.969019 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:00.969596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:00.984417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] HTTP exception thrown: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Request method failure captured: Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e HTTP/1.1 Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4v6duY-JjrZHZbxsxLgB31jbTd9mxoms6wfxl0_GttHJ8QCB_2g9-e_75Vk33c6zdnwFhvk7KHijRS-1PB0FygJKzYAu3szN0G8NJm0Jb6ihb3lMTUz9wCUoUhrmhaH3tjuJZ9k2XSLuwTKUP3HNR65jewDyyhpHsWX4Gis0uwXBc Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:00.986029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f992a8ccca8d487abd91dc6d0baaf3bc"}]}] Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 51b2f292cea24a21928e2adcef0c3786 Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.987720 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '44cad347-b818-4dc8-b9ab-26e38b5edf8e'} Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:00.988946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. Oct 17 07:11:00.990452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:00.992854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Returning 404 to user: Instance 44cad347-b818-4dc8-b9ab-26e38b5edf8e could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:00.994454 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a2de708e-0e43-4e8e-86d6-c773be439893 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e" status: 404 len: 111 microversion: 2.1 time: 0.042676 Oct 17 07:11:00.995704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 566/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:11:00 2022] GET /compute/v2.1/servers/44cad347-b818-4dc8-b9ab-26e38b5edf8e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:02.151899 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:02.152565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:02.161585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:02.162067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:02.162558 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:02.163228 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:02.163679 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:02.164096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:02.178891 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] HTTP exception thrown: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Request method failure captured: Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a HTTP/1.1 Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP4v6duY-JjrZHZbxsxLgB31jbTd9mxoms6wfxl0_GttHJ8QCB_2g9-e_75Vk33c6zdnwFhvk7KHijRS-1PB0FygJKzYAu3szN0G8NJm0Jb6ihb3lMTUz9wCUoUhrmhaH3tjuJZ9k2XSLuwTKUP3HNR65jewDyyhpHsWX4Gis0uwXBc Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:11:02.182839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f992a8ccca8d487abd91dc6d0baaf3bc"}]}] Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 51b2f292cea24a21928e2adcef0c3786 Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.184259 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '69682426-13b0-4029-8721-6832e661201a'} Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:02.185150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.186449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.187801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Returning 404 to user: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:02.187801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c78ea7ec-87c6-4075-86cf-0f40e486e627 tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 404 len: 111 microversion: 2.1 time: 0.033953 Oct 17 07:11:02.187801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 558/1124] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:11:02 2022] DELETE /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:02.190110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:02.190722 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] [instance: 69682426-13b0-4029-8721-6832e661201a] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:02.196948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:02.197427 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:02.197862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:02.198543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:02.198994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:02.199447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:02.213499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] HTTP exception thrown: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Request method failure captured: Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a HTTP/1.1 Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP4v6duY-JjrZHZbxsxLgB31jbTd9mxoms6wfxl0_GttHJ8QCB_2g9-e_75Vk33c6zdnwFhvk7KHijRS-1PB0FygJKzYAu3szN0G8NJm0Jb6ihb3lMTUz9wCUoUhrmhaH3tjuJZ9k2XSLuwTKUP3HNR65jewDyyhpHsWX4Gis0uwXBc Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:02.215539 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f992a8ccca8d487abd91dc6d0baaf3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f992a8ccca8d487abd91dc6d0baaf3bc"}]}] Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: f992a8ccca8d487abd91dc6d0baaf3bc Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033972521 Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 51b2f292cea24a21928e2adcef0c3786 Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-1033972521-project Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.217482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '69682426-13b0-4029-8721-6832e661201a'} Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:02.218491 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. Oct 17 07:11:02.220684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:02.222338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] Returning 404 to user: Instance 69682426-13b0-4029-8721-6832e661201a could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:02.222338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9892f909-eca4-4c95-9b34-05552d75455c tempest-AttachVolumeTestJSON-1033972521 tempest-AttachVolumeTestJSON-1033972521-project] 10.222.0.36 "GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 17 07:11:02.222338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 567/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:11:02 2022] GET /compute/v2.1/servers/69682426-13b0-4029-8721-6832e661201a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:07.447700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-485d6bc2-e203-4aeb-a98b-0054a2e002a9 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Action: 'create', calling method: .version_select at 0x7f4acd271040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2017710929"}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:11:07.751368 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-485d6bc2-e203-4aeb-a98b-0054a2e002a9 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.457556 Oct 17 07:11:07.752059 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 559/1126] 10.222.0.36 () {60 vars in 1155 bytes} [Mon Oct 17 07:11:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 07:11:07.768821 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f8ce911a-2489-40d3-8c10-fa0c17405b35 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd17a3a0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:07.821503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f8ce911a-2489-40d3-8c10-fa0c17405b35 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 200 len: 345 microversion: 2.1 time: 0.060115 Oct 17 07:11:07.822237 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 568/1127] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:07 2022] GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:08.837299 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-eb85c624-5ed6-4e01-8a42-ef298d70d12d tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd3b3700>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:08.885427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-eb85c624-5ed6-4e01-8a42-ef298d70d12d tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 200 len: 346 microversion: 2.1 time: 0.052506 Oct 17 07:11:08.886110 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 560/1128] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:08 2022] GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:08.901749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-402ea28d-ce4f-4b42-a7a8-ccb94fbb02a2 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Action: 'create', calling method: .version_select at 0x7f4acd1971f0>, body: {"snapshot": {"volume_id": "72627d1b-c58c-4edf-8ccf-3b7a3eb44184", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-821652077"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:11:09.060671 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-402ea28d-ce4f-4b42-a7a8-ccb94fbb02a2 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163185 Oct 17 07:11:09.061258 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 569/1129] 10.222.0.36 () {60 vars in 1162 bytes} [Mon Oct 17 07:11:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:09.072261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0dd697c5-d7e4-44a2-9fb1-23ca09f87f96 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd304280>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:09.108789 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0dd697c5-d7e4-44a2-9fb1-23ca09f87f96 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 200 len: 286 microversion: 2.1 time: 0.040226 Oct 17 07:11:09.109578 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 561/1130] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:09 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:09.121941 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3b2209d5-74de-4557-ab5d-0d0041822059 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd285f70>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:09.154194 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3b2209d5-74de-4557-ab5d-0d0041822059 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036089 Oct 17 07:11:09.155575 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 570/1131] 10.222.0.36 () {58 vars in 1140 bytes} [Mon Oct 17 07:11:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:09.166389 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-646588f2-dfda-4191-bef1-13949e0eb5c3 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd3dd940>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:09.197178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-646588f2-dfda-4191-bef1-13949e0eb5c3 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 200 len: 286 microversion: 2.1 time: 0.034571 Oct 17 07:11:09.197767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 562/1132] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:09 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:10.211113 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7594d9c4-9097-43ab-9a6d-c2357c407afa tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd197f70>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:10.243588 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7594d9c4-9097-43ab-9a6d-c2357c407afa tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 200 len: 286 microversion: 2.1 time: 0.036806 Oct 17 07:11:10.244163 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 571/1133] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:10 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:11.187090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:11.189468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:11.191542 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:11:11.198133 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:11.198617 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:11.199055 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:11.199782 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:11.200505 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:11.200930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:11.230190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ee60b28a-1a84-44dc-8658-d1700a73d25c tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048458 Oct 17 07:11:11.230931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 563/1134] 10.222.0.36 () {60 vars in 1343 bytes} [Mon Oct 17 07:11:11 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:11:11.257912 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3612f815-ab16-4bcc-ba67-fcf3f5b0521d tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd288700>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:11.289100 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3612f815-ab16-4bcc-ba67-fcf3f5b0521d tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 200 len: 286 microversion: 2.1 time: 0.036021 Oct 17 07:11:11.289717 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 572/1135] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:11 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:11.301428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:11.301926 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:11.307823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:11.308310 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:11.308750 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:11.309471 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:11.309929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:11.310373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:11.335561 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:11:11.410873 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c8784511-410a-4b95-b1c0-83adf1781af7 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 204 len: 0 microversion: 2.20 time: 0.113059 Oct 17 07:11:11.411504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 564/1136] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 17 07:11:11 2022] DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 07:11:11.419694 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:11.420536 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:11.423033 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:11:11.428467 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:11.428955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:11.429391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:11.430103 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:11.430537 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:11.430958 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:11.566323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:11.574811 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:11.577221 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:11.578492 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-26c8800a-8bea-45c3-b92a-de32d7071878 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.162630 Oct 17 07:11:11.588008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 573/1137] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:11 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:11:12.302709 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-73572085-fd09-46ec-8f80-3df86bb6361e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd561790>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:12.334287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-73572085-fd09-46ec-8f80-3df86bb6361e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 200 len: 287 microversion: 2.1 time: 0.035740 Oct 17 07:11:12.334864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 565/1138] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:12 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:11:12.346278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-601d4aa0-e5b6-470e-988f-9e45c43097bf tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd197700>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:12.402405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-601d4aa0-e5b6-470e-988f-9e45c43097bf tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 202 len: 0 microversion: 2.1 time: 0.060262 Oct 17 07:11:12.402968 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 574/1139] 10.222.0.36 () {58 vars in 1254 bytes} [Mon Oct 17 07:11:12 2022] DELETE /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:11:12.411539 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fc240db4-1fd1-49f5-b0f2-97b1cd838a57 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd3dd940>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:12.442438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fc240db4-1fd1-49f5-b0f2-97b1cd838a57 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 200 len: 286 microversion: 2.1 time: 0.034647 Oct 17 07:11:12.442994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 566/1140] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:12 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:12.604405 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:12.604945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:12.610988 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:12.611570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:12.612048 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:12.612972 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:12.613503 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:12.614061 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:12.746438 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:12.755843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:12.757290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:12.758447 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ea69f0b3-ec9d-4091-afb4-1b26efa7a23a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.158117 Oct 17 07:11:12.758993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 575/1141] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:12 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:11:13.455666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-09bc9861-eece-4e7e-a737-9f4627fcc3ce tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd0e1310>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:13.485058 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-09bc9861-eece-4e7e-a737-9f4627fcc3ce tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] HTTP exception thrown: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-09bc9861-eece-4e7e-a737-9f4627fcc3ce tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Request method failure captured: Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b HTTP/1.1 Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTQALKzIZL59nWrHPMp2TwYJJt7NY4q-fzO-7Wy2vUMwo-H_Vy2boYc_c2dyRmvEb_Zp_uKOaq1p1fJkYD2GUAfQ5pj91QcB9sbC7KNpa3Q_vDb7jThqj_af9RWN2qbNrZFV7O_VxM_dwj1S0m6kLf9oMMeHGhrIj8m1AU-Agfx970Tw Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:11:13.487490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e2a9c2575114667bd8ed552b3725ed7"}]}] Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 99a16caa037b4cf6b1e62a5779e04e56 Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '5be547fe-79f6-4d45-b6b0-91d4b5b33a7b'} Oct 17 07:11:13.489072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. (HTTP 404) (Request-ID: req-e4bd4137-605a-4473-b9cf-5ed9bd63acf4) Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.490164 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:13.491402 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 07:11:13.492780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-09bc9861-eece-4e7e-a737-9f4627fcc3ce tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Returning 404 to user: Snapshot 5be547fe-79f6-4d45-b6b0-91d4b5b33a7b could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:13.494335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-09bc9861-eece-4e7e-a737-9f4627fcc3ce tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b" status: 404 len: 111 microversion: 2.1 time: 0.037745 Oct 17 07:11:13.495504 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 567/1142] 10.222.0.36 () {58 vars in 1251 bytes} [Mon Oct 17 07:11:13 2022] GET /compute/v2.1/os-snapshots/5be547fe-79f6-4d45-b6b0-91d4b5b33a7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:13.498784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-422c44ca-a062-43d2-8252-75ce193b769f tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd1971f0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:13.563141 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-422c44ca-a062-43d2-8252-75ce193b769f tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 202 len: 0 microversion: 2.1 time: 0.068972 Oct 17 07:11:13.563818 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 576/1143] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:11:13 2022] DELETE /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:11:13.571929 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-037be5d8-82a7-4393-b876-259885d75acd tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4accf70550>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:13.625220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-037be5d8-82a7-4393-b876-259885d75acd tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 200 len: 345 microversion: 2.1 time: 0.056678 Oct 17 07:11:13.625836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 568/1144] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:13 2022] GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:13.786900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:13.788494 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:13.799390 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:13.801869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:13.802653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:13.804496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:13.805482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:13.806772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:14.063930 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:14.104434 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:14.105923 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:14.107248 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-caa28339-1149-4ba8-842a-7f0fe016b3a3 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1719 microversion: 2.20 time: 0.326401 Oct 17 07:11:14.108156 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 577/1145] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:13 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1719 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:11:14.580034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-8ad14d4e-cc34-4d93-9e76-aa11a506cf8a req-5acd4bc2-62c3-4e9d-9eba-b63001f3c302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0cefb-566e-491e-adc2-a28637e2aa34", "name": "network-vif-deleted", "tag": "90cbeff0-4e31-48ef-9a6a-fb89dbbbee32"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:11:14.591329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8ad14d4e-cc34-4d93-9e76-aa11a506cf8a req-5acd4bc2-62c3-4e9d-9eba-b63001f3c302 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:14.592432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8ad14d4e-cc34-4d93-9e76-aa11a506cf8a req-5acd4bc2-62c3-4e9d-9eba-b63001f3c302 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:14.592969 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8ad14d4e-cc34-4d93-9e76-aa11a506cf8a req-5acd4bc2-62c3-4e9d-9eba-b63001f3c302 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:14.604384 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-8ad14d4e-cc34-4d93-9e76-aa11a506cf8a req-5acd4bc2-62c3-4e9d-9eba-b63001f3c302 service nova] Creating event network-vif-deleted:90cbeff0-4e31-48ef-9a6a-fb89dbbbee32 for instance 59b0cefb-566e-491e-adc2-a28637e2aa34 on hv-cinder-84506 Oct 17 07:11:14.610737 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-8ad14d4e-cc34-4d93-9e76-aa11a506cf8a req-5acd4bc2-62c3-4e9d-9eba-b63001f3c302 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036274 Oct 17 07:11:14.611907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 569/1146] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:14.642795 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0189e9b-da68-42da-b2d3-e56039c621c1 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd1483a0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:14.678160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-a0189e9b-da68-42da-b2d3-e56039c621c1 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] HTTP exception thrown: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0189e9b-da68-42da-b2d3-e56039c621c1 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Request method failure captured: Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 HTTP/1.1 Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTQALKzIZL59nWrHPMp2TwYJJt7NY4q-fzO-7Wy2vUMwo-H_Vy2boYc_c2dyRmvEb_Zp_uKOaq1p1fJkYD2GUAfQ5pj91QcB9sbC7KNpa3Q_vDb7jThqj_af9RWN2qbNrZFV7O_VxM_dwj1S0m6kLf9oMMeHGhrIj8m1AU-Agfx970Tw Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:14.681068 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e2a9c2575114667bd8ed552b3725ed7"}]}] Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 99a16caa037b4cf6b1e62a5779e04e56 Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '72627d1b-c58c-4edf-8ccf-3b7a3eb44184'} Oct 17 07:11:14.682669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. (HTTP 404) (Request-ID: req-dff3e7f5-0b18-4972-b376-bfd36577167e) Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.683733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:14.686396 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 07:11:14.689411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.690953 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.692914 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0189e9b-da68-42da-b2d3-e56039c621c1 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Returning 404 to user: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:14.695417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0189e9b-da68-42da-b2d3-e56039c621c1 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 404 len: 109 microversion: 2.1 time: 0.057996 Oct 17 07:11:14.696839 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 578/1147] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:14 2022] GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:14.707494 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-738feaa3-7f99-4fb0-8e6b-1087ae276e98 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd60c4c0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:14.737941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-738feaa3-7f99-4fb0-8e6b-1087ae276e98 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] HTTP exception thrown: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-738feaa3-7f99-4fb0-8e6b-1087ae276e98 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Request method failure captured: Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 HTTP/1.1 Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTQALKzIZL59nWrHPMp2TwYJJt7NY4q-fzO-7Wy2vUMwo-H_Vy2boYc_c2dyRmvEb_Zp_uKOaq1p1fJkYD2GUAfQ5pj91QcB9sbC7KNpa3Q_vDb7jThqj_af9RWN2qbNrZFV7O_VxM_dwj1S0m6kLf9oMMeHGhrIj8m1AU-Agfx970Tw Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:11:14.740019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e2a9c2575114667bd8ed552b3725ed7"}]}] Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 99a16caa037b4cf6b1e62a5779e04e56 Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '72627d1b-c58c-4edf-8ccf-3b7a3eb44184'} Oct 17 07:11:14.741554 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. (HTTP 404) (Request-ID: req-bc1e0718-2514-40d0-8935-a1b69ebb42d2) Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.745931 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 07:11:14.747826 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 07:11:14.749224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-738feaa3-7f99-4fb0-8e6b-1087ae276e98 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Returning 404 to user: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-738feaa3-7f99-4fb0-8e6b-1087ae276e98 tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 404 len: 109 microversion: 2.1 time: 0.038649 Oct 17 07:11:14.750849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 570/1148] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:11:14 2022] DELETE /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:14.754769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ac4ce565-2b65-43a2-b8c9-b43b11835c1e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Calling method '.version_select at 0x7f4acd336dc0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:14.798289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-ac4ce565-2b65-43a2-b8c9-b43b11835c1e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] HTTP exception thrown: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ac4ce565-2b65-43a2-b8c9-b43b11835c1e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Request method failure captured: Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 HTTP/1.1 Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTQALKzIZL59nWrHPMp2TwYJJt7NY4q-fzO-7Wy2vUMwo-H_Vy2boYc_c2dyRmvEb_Zp_uKOaq1p1fJkYD2GUAfQ5pj91QcB9sbC7KNpa3Q_vDb7jThqj_af9RWN2qbNrZFV7O_VxM_dwj1S0m6kLf9oMMeHGhrIj8m1AU-Agfx970Tw Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:14.801046 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e2a9c2575114667bd8ed552b3725ed7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e2a9c2575114667bd8ed552b3725ed7"}]}] Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 6e2a9c2575114667bd8ed552b3725ed7 Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420125288 Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 99a16caa037b4cf6b1e62a5779e04e56 Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420125288-project Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '72627d1b-c58c-4edf-8ccf-3b7a3eb44184'} Oct 17 07:11:14.802812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. (HTTP 404) (Request-ID: req-bc4af44a-e712-4360-8612-57d420216be1) Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.803856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:14.808992 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 07:11:14.810884 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ac4ce565-2b65-43a2-b8c9-b43b11835c1e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] Returning 404 to user: Volume 72627d1b-c58c-4edf-8ccf-3b7a3eb44184 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ac4ce565-2b65-43a2-b8c9-b43b11835c1e tempest-VolumesSnapshotsTestJSON-420125288 tempest-VolumesSnapshotsTestJSON-420125288-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184" status: 404 len: 109 microversion: 2.1 time: 0.055902 Oct 17 07:11:14.813383 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 579/1149] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:14 2022] GET /compute/v2.1/os-volumes/72627d1b-c58c-4edf-8ccf-3b7a3eb44184 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:15.150334 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:15.159551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:15.174695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:15.175377 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:15.175916 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:15.176903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:15.177466 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:15.178178 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:15.241096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:15.241096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:15.241096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:15.248410 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lazy-loading 'fault' on Instance uuid 59b0cefb-566e-491e-adc2-a28637e2aa34 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:11:15.337829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:15.350960 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:15.353375 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d404b2974f64aa8a6c32adfc3f7b0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721190b4f16142749dda7253941be2c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:11:15.355490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-62a1c797-4912-47a4-bf54-becc1eef658f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 200 len: 1369 microversion: 2.20 time: 0.221949 Oct 17 07:11:15.357332 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 571/1150] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:15 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 07:11:16.385087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:16.385841 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:16.393682 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:16.394210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:16.394885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:16.396446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:16.397183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:16.397784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:16.405902 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:11:16.416076 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] HTTP exception thrown: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Request method failure captured: Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 HTTP/1.1 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP6CRCZy5P8IXH__Lkagc-zFQhdhumibMflLdPlyH8VSB19o9r-B7MfouFVFPeReZKMhv3GlHt8hMPvpCH8ARZTOfvGxY9H3JENdmNqv0ZcaNBNpfyyjMxdo3XgyG95jv7U1CgfYL04ZZr3KsIvZanw7JdF8zMbhQPFWByyYB3-aVxc Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:16.417742 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/721190b4f16142749dda7253941be2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_721190b4f16142749dda7253941be2c3"}]}] Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d404b2974f64aa8a6c32adfc3f7b0bc Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:16.419435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '59b0cefb-566e-491e-adc2-a28637e2aa34'} Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:16.420279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:16.421524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:16.423620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Returning 404 to user: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:16.425264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-13153a93-3bd2-49cd-adb6-f5cc54cfb171 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 404 len: 111 microversion: 2.20 time: 0.044559 Oct 17 07:11:16.426028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 580/1151] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:16 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:11:16.434868 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-99cfa1e2-ab55-4f70-976b-3a14ccd78ba1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '.version_select at 0x7f4acd014310>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:16.456090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR oslo.messaging._drivers.impl_rabbit [None req-99cfa1e2-ab55-4f70-976b-3a14ccd78ba1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [a279eaa2-765c-4c5d-8e64-461c98fbf4c9] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 07:11:16.576391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c00a342-412a-4771-9025-ada5f4d2ec7a tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Action: 'create', calling method: .version_select at 0x7f4acd2851f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-959341300", "metadata": {"Type": "work"}}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:11:16.908514 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c00a342-412a-4771-9025-ada5f4d2ec7a tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.458478 Oct 17 07:11:16.912628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 581/1152] 10.222.0.36 () {60 vars in 1156 bytes} [Mon Oct 17 07:11:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 17 07:11:16.923243 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-77b7e103-8b23-4a51-afb0-87a1537cfecd tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Calling method '.version_select at 0x7f4acd197940>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:16.974562 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-77b7e103-8b23-4a51-afb0-87a1537cfecd tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1" status: 200 len: 352 microversion: 2.1 time: 0.056355 Oct 17 07:11:16.975155 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 582/1153] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:16 2022] GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:17.468360 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [None req-99cfa1e2-ab55-4f70-976b-3a14ccd78ba1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [a279eaa2-765c-4c5d-8e64-461c98fbf4c9] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56952. Oct 17 07:11:17.486795 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-99cfa1e2-ab55-4f70-976b-3a14ccd78ba1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43976790" status: 204 len: 0 microversion: 2.20 time: 1.055929 Oct 17 07:11:17.487427 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 572/1154] 10.222.0.36 () {60 vars in 1256 bytes} [Mon Oct 17 07:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43976790 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 07:11:17.989382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-56691b6f-4c6d-46b9-a833-957dfa9ae8d4 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Calling method '.version_select at 0x7f4ad0ad5310>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:18.041883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-56691b6f-4c6d-46b9-a833-957dfa9ae8d4 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1" status: 200 len: 353 microversion: 2.1 time: 0.056840 Oct 17 07:11:18.042571 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 583/1155] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:17 2022] GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:11:18.055724 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-098175f0-ff4f-47c2-a2c5-742e8f68c085 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Calling method '.version_select at 0x7f4acd304280>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:18.105544 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-098175f0-ff4f-47c2-a2c5-742e8f68c085 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1" status: 200 len: 353 microversion: 2.1 time: 0.053591 Oct 17 07:11:18.106119 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 573/1156] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:18 2022] GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:18.120070 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-44e430a1-edb2-4b3d-b485-b574182e1ebe tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Calling method '.version_select at 0x7f4acd1dd670>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:18.195450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-44e430a1-edb2-4b3d-b485-b574182e1ebe tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1" status: 202 len: 0 microversion: 2.1 time: 0.079103 Oct 17 07:11:18.196020 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 584/1157] 10.222.0.36 () {58 vars in 1248 bytes} [Mon Oct 17 07:11:18 2022] DELETE /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:11:18.205043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d4e1aa07-3360-4991-8042-e4cd421b0bfa tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Calling method '.version_select at 0x7f4acd164280>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:18.255440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d4e1aa07-3360-4991-8042-e4cd421b0bfa tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1" status: 200 len: 352 microversion: 2.1 time: 0.055233 Oct 17 07:11:18.256124 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 574/1158] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:18 2022] GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:19.271346 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fde92734-81c4-47ea-ae7b-09e8325ddc65 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Calling method '.version_select at 0x7f4acd197a60>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:19.304716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-fde92734-81c4-47ea-ae7b-09e8325ddc65 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] HTTP exception thrown: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fde92734-81c4-47ea-ae7b-09e8325ddc65 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Request method failure captured: Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 HTTP/1.1 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTQAUco6XTlozCdabeGPlSD5C6PbOibUyypUGRXbTgD1qRDNb3_fwhhrNZf_CHjsb6EW29ZePEqdR5o_5_241-W814LVXoxIQjtPDRVe-4WgvtlnK-dIbVI9vbFE9IhM4qMH003dnzcVFtw3470BI6UinLmxTVGPmFjPaJsE7SvdU-_0 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 8dd5c25527c5495596f40e63b3f31a69 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesGetTestJSON-1177125073 Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:19.306673 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8dd5c25527c5495596f40e63b3f31a69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8dd5c25527c5495596f40e63b3f31a69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8dd5c25527c5495596f40e63b3f31a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8dd5c25527c5495596f40e63b3f31a69"}]}] Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesGetTestJSON-1177125073 Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 8dd5c25527c5495596f40e63b3f31a69 Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesGetTestJSON-1177125073 Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesGetTestJSON-1177125073-project Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 4d33f09e872b44a281c4bc30dacf0c82 Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesGetTestJSON-1177125073-project Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '87da905b-7ff1-440f-b15f-bf03bf7d5af1'} Oct 17 07:11:19.308499 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. (HTTP 404) (Request-ID: req-e6806c61-12ff-4cf3-9a8c-75317c22d5e7) Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.309645 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 07:11:19.310889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 07:11:19.312857 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fde92734-81c4-47ea-ae7b-09e8325ddc65 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] Returning 404 to user: Volume 87da905b-7ff1-440f-b15f-bf03bf7d5af1 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fde92734-81c4-47ea-ae7b-09e8325ddc65 tempest-VolumesGetTestJSON-1177125073 tempest-VolumesGetTestJSON-1177125073-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1" status: 404 len: 109 microversion: 2.1 time: 0.042057 Oct 17 07:11:19.315092 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 585/1159] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:19 2022] GET /compute/v2.1/os-volumes/87da905b-7ff1-440f-b15f-bf03bf7d5af1 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:11:19.447522 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:19.448780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:19.458323 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:19.459278 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:19.459910 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:19.461276 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:19.461900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:19.462937 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:19.486445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] HTTP exception thrown: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Request method failure captured: Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 HTTP/1.1 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP6CRCZy5P8IXH__Lkagc-zFQhdhumibMflLdPlyH8VSB19o9r-B7MfouFVFPeReZKMhv3GlHt8hMPvpCH8ARZTOfvGxY9H3JENdmNqv0ZcaNBNpfyyjMxdo3XgyG95jv7U1CgfYL04ZZr3KsIvZanw7JdF8zMbhQPFWByyYB3-aVxc Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:11:19.488250 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/721190b4f16142749dda7253941be2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_721190b4f16142749dda7253941be2c3"}]}] Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 8d404b2974f64aa8a6c32adfc3f7b0bc Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.490016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '59b0cefb-566e-491e-adc2-a28637e2aa34'} Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:19.490878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.492740 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.494663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Returning 404 to user: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:19.494663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c054a29f-b910-427d-a7fd-b9bf2df9a4e8 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 404 len: 111 microversion: 2.20 time: 0.046749 Oct 17 07:11:19.494663 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 575/1160] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 17 07:11:19 2022] DELETE /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:11:19.499805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:19.500573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 59b0cefb-566e-491e-adc2-a28637e2aa34] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:19.506892 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:19.507826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:19.508025 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:19.508807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:19.509353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:19.509967 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:19.525191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] HTTP exception thrown: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Request method failure captured: Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 HTTP/1.1 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP6CRCZy5P8IXH__Lkagc-zFQhdhumibMflLdPlyH8VSB19o9r-B7MfouFVFPeReZKMhv3GlHt8hMPvpCH8ARZTOfvGxY9H3JENdmNqv0ZcaNBNpfyyjMxdo3XgyG95jv7U1CgfYL04ZZr3KsIvZanw7JdF8zMbhQPFWByyYB3-aVxc Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:19.527012 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/721190b4f16142749dda7253941be2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_721190b4f16142749dda7253941be2c3"}]}] Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d404b2974f64aa8a6c32adfc3f7b0bc Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.528442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '59b0cefb-566e-491e-adc2-a28637e2aa34'} Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:19.529208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. Oct 17 07:11:19.531004 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:19.533676 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Returning 404 to user: Instance 59b0cefb-566e-491e-adc2-a28637e2aa34 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:19.534695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd299890-f7b1-45f5-aa97-cb96f62b3ee1 tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34" status: 404 len: 111 microversion: 2.20 time: 0.039084 Oct 17 07:11:19.535437 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 586/1161] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:19 2022] GET /compute/v2.1/servers/59b0cefb-566e-491e-adc2-a28637e2aa34 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:11:20.703149 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:20.703669 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:20.710074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:20.710551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:20.710986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:20.711802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:20.712146 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:20.712562 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:20.719565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:11:20.728954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] HTTP exception thrown: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Request method failure captured: Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 HTTP/1.1 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTP6CRCZy5P8IXH__Lkagc-zFQhdhumibMflLdPlyH8VSB19o9r-B7MfouFVFPeReZKMhv3GlHt8hMPvpCH8ARZTOfvGxY9H3JENdmNqv0ZcaNBNpfyyjMxdo3XgyG95jv7U1CgfYL04ZZr3KsIvZanw7JdF8zMbhQPFWByyYB3-aVxc Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:11:20.730476 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/721190b4f16142749dda7253941be2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_721190b4f16142749dda7253941be2c3"}]}] Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 8d404b2974f64aa8a6c32adfc3f7b0bc Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.731956 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '090d6db5-0067-4e80-90c6-ac2c9fb23ed1'} Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:20.732774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.734131 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.735443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Returning 404 to user: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:20.735443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f70384a2-ed5c-4316-9473-93ab1783af5a tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 404 len: 111 microversion: 2.20 time: 0.033428 Oct 17 07:11:20.735443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 576/1162] 10.222.0.36 () {60 vars in 1280 bytes} [Mon Oct 17 07:11:20 2022] DELETE /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 07:11:20.740601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:20.741290 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] [instance: 090d6db5-0067-4e80-90c6-ac2c9fb23ed1] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:11:20.747949 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:20.748478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:20.749495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:20.750234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:11:20.750689 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:11:20.751115 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:11:20.765132 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] HTTP exception thrown: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Request method failure captured: Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 HTTP/1.1 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP6CRCZy5P8IXH__Lkagc-zFQhdhumibMflLdPlyH8VSB19o9r-B7MfouFVFPeReZKMhv3GlHt8hMPvpCH8ARZTOfvGxY9H3JENdmNqv0ZcaNBNpfyyjMxdo3XgyG95jv7U1CgfYL04ZZr3KsIvZanw7JdF8zMbhQPFWByyYB3-aVxc Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:11:20.766714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/721190b4f16142749dda7253941be2c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/721190b4f16142749dda7253941be2c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_721190b4f16142749dda7253941be2c3"}]}] Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 721190b4f16142749dda7253941be2c3 Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-731751518 Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 8d404b2974f64aa8a6c32adfc3f7b0bc Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-731751518-project Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.768500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '090d6db5-0067-4e80-90c6-ac2c9fb23ed1'} Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:11:20.769349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. Oct 17 07:11:20.770852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:11:20.772134 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] Returning 404 to user: Instance 090d6db5-0067-4e80-90c6-ac2c9fb23ed1 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:11:20.772134 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7317afff-514e-4eab-993f-f92993a2be1f tempest-AttachVolumeShelveTestJSON-731751518 tempest-AttachVolumeShelveTestJSON-731751518-project] 10.222.0.36 "GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1" status: 404 len: 111 microversion: 2.20 time: 0.031577 Oct 17 07:11:20.772134 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 587/1163] 10.222.0.36 () {60 vars in 1277 bytes} [Mon Oct 17 07:11:20 2022] GET /compute/v2.1/servers/090d6db5-0067-4e80-90c6-ac2c9fb23ed1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 07:11:22.272747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-de65758b-a8c3-42be-8cc4-9cabcf6d98c1 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd0c3670>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:22.330676 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-de65758b-a8c3-42be-8cc4-9cabcf6d98c1 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9a5b2ad6-71ff-419b-8ce7-8cde2b046cf4" status: 200 len: 350 microversion: 2.1 time: 0.062482 Oct 17 07:11:22.331633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 577/1164] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:22 2022] GET /compute/v2.1/os-volumes/9a5b2ad6-71ff-419b-8ce7-8cde2b046cf4 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:23.748110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5b7f993e-3bae-421b-b4ac-a6e28b0065c8 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd21d8b0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:23.802769 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5b7f993e-3bae-421b-b4ac-a6e28b0065c8 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/12bbf122-7c3c-463e-8770-6dcef4fd538a" status: 200 len: 351 microversion: 2.1 time: 0.058373 Oct 17 07:11:23.810666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 588/1165] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:23 2022] GET /compute/v2.1/os-volumes/12bbf122-7c3c-463e-8770-6dcef4fd538a => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:25.177588 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8dc7d261-e7ce-47fb-b62f-dd1ecaa740b9 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4accfa8e50>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.230183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8dc7d261-e7ce-47fb-b62f-dd1ecaa740b9 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/03ac7bde-227a-4a4f-a797-1c7078f6b55e" status: 200 len: 350 microversion: 2.1 time: 0.056719 Oct 17 07:11:25.230865 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 578/1166] 10.222.0.36 () {58 vars in 1245 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes/03ac7bde-227a-4a4f-a797-1c7078f6b55e => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:25.244703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bb6a6ebd-02b1-4929-8f3e-6097ac05586e tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd197040>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.326500 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bb6a6ebd-02b1-4929-8f3e-6097ac05586e tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085954 Oct 17 07:11:25.327659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 589/1167] 10.222.0.36 () {58 vars in 1134 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:11:25.341847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5937a5dd-c96a-4b57-b33f-dea7782b4e02 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd1649d0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.426251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5937a5dd-c96a-4b57-b33f-dea7782b4e02 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088049 Oct 17 07:11:25.426815 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 579/1168] 10.222.0.36 () {58 vars in 1149 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:25.440648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0d799bb-0d36-4ccb-b62c-784cc666a75f tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd21d820>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.526931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0d799bb-0d36-4ccb-b62c-784cc666a75f tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089944 Oct 17 07:11:25.527542 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 590/1169] 10.222.0.36 () {58 vars in 1134 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:11:25.541864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0829cb71-d37c-4a64-a16e-5421dbf3e473 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd57e8b0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.629130 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0829cb71-d37c-4a64-a16e-5421dbf3e473 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091337 Oct 17 07:11:25.629849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 580/1170] 10.222.0.36 () {58 vars in 1167 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:25.643760 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c9c6c065-9e6e-466b-9b50-62fe5afffa49 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd22fe50>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.731015 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c9c6c065-9e6e-466b-9b50-62fe5afffa49 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091674 Oct 17 07:11:25.731680 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 591/1171] 10.222.0.36 () {58 vars in 1170 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:25.745811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-20bb734a-5f27-4f2b-b3fe-e7a13c02ec89 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd2aa9d0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.842079 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-20bb734a-5f27-4f2b-b3fe-e7a13c02ec89 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100276 Oct 17 07:11:25.844482 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 581/1172] 10.222.0.36 () {58 vars in 1155 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:11:25.857749 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6942edf0-d514-4786-879b-5c13d304fb49 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4acd336940>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:25.950924 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6942edf0-d514-4786-879b-5c13d304fb49 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095925 Oct 17 07:11:25.952762 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 592/1173] 10.222.0.36 () {58 vars in 1188 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:11:25.965869 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d4810f0f-ef9f-43db-a4c6-1675e9386af5 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] Calling method '.version_select at 0x7f4accfa84c0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:11:26.050854 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d4810f0f-ef9f-43db-a4c6-1675e9386af5 tempest-VolumesTestJSON-1237981851 tempest-VolumesTestJSON-1237981851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088661 Oct 17 07:11:26.051579 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 582/1174] 10.222.0.36 () {58 vars in 1155 bytes} [Mon Oct 17 07:11:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:11:58.754672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=11 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:11:58.755782 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=5 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:11:59.109875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-227428a5-3d08-4b52-a566-96449aa16f8d tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Action: 'create', calling method: .version_select at 0x7f4acd22ff70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-3037217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML6KAjCVaYe3ZSSkjSPtVBxZPiCw8z9Yh9mXMn4gZGiXrARYQXNfYc0/1laxs2iDzom59PsSXzMo8PbGpo3Dledj3UMdSjYPSOpLuBiO6ltMHId+3tOZGBeXyRlpXJNhA=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:11:59.128776 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-227428a5-3d08-4b52-a566-96449aa16f8d tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:11:59.133115 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-227428a5-3d08-4b52-a566-96449aa16f8d tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for user 2dda9b6c5edd4dec87e4d23ecfcea5e9 and project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:11:59.162935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-227428a5-3d08-4b52-a566-96449aa16f8d tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.409371 Oct 17 07:11:59.163726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 593/1175] 10.222.0.36 () {60 vars in 1159 bytes} [Mon Oct 17 07:11:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:12:21.013176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:21.014046 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:21.015035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:12:21.015190 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Mon Oct 17 07:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 17 07:12:21.020961 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-107919191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-3037217", "security_groups": [{"name": "tempest-secgroup-smoke-1984779673"}], "block_device_mapping_v2": [{"uuid": "4125d402-2fc4-4c49-922b-6d79550c69d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb86a052-14f2-4094-bbba-a8fec1a4a781"}]}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:21.132329 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.network.neutron [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] validate_networks() for [('cb86a052-14f2-4094-bbba-a8fec1a4a781', None, None, None, None, None)] {{(pid=118996) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:12:21.502610 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Flavor limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:12:21.503056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Image limits 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:12:21.503599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Flavor pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:12:21.504002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Image pref 0:0:0 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:12:21.504409 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.virt.hardware [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:12:21.513112 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:21.513607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:21.514025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:21.514744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:21.515194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:21.515642 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:21.533005 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:12:21.536933 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.quota [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for user 2dda9b6c5edd4dec87e4d23ecfcea5e9 and project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:12:21.593062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Going to run 1 instances... {{(pid=118996) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:12:21.595730 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4125d402-2fc4-4c49-922b-6d79550c69d5',volume_size=None,volume_type=None)] {{(pid=118996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:12:21.726452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-53d5b887-1fd7-4e20-8b03-a35805d36d82 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714546 Oct 17 07:12:21.727094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 583/1176] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:12:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:12:21.738564 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-db56c38c-ce77-4c12-9b62-1667533bbde9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:21.739780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-db56c38c-ce77-4c12-9b62-1667533bbde9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:21.741889 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:21.742526 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:21.797521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db56c38c-ce77-4c12-9b62-1667533bbde9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:21.804312 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-db56c38c-ce77-4c12-9b62-1667533bbde9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1091 microversion: 2.1 time: 0.070176 Oct 17 07:12:21.804861 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 594/1177] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:21 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1091 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:22.827103 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:22.827697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:22.834036 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:22.834508 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:22.834930 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:22.835628 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:22.836069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:22.836487 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:22.899335 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:22.906944 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c1d73e0a-f0cf-458b-a907-8124eb8c95b2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1141 microversion: 2.1 time: 0.084475 Oct 17 07:12:22.907545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 584/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:22 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1141 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:23.929035 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:23.929647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:23.936181 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:23.936661 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:23.937098 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:23.937781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:23.938233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:23.938655 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:23.998872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:24.006981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-435b284b-fc3b-48d9-86d6-199185cf05fb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1141 microversion: 2.1 time: 0.081764 Oct 17 07:12:24.007581 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 595/1179] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:23 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1141 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:25.029924 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:25.030565 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:25.037366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:25.037841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:25.038266 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:25.038939 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:25.039411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:25.039828 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:25.110689 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:25.119193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-77e52910-ef08-49e5-9fa9-de09200ab286 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1207 microversion: 2.1 time: 0.093053 Oct 17 07:12:25.125057 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 585/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:25 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1207 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:26.141714 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:26.142331 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:26.149478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:26.150572 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:26.151017 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:26.152192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:26.152703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:26.153139 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:26.363227 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:26.371612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c65d5714-deb3-4de4-9237-8f315d8606cd tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.233650 Oct 17 07:12:26.372180 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 596/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:26 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:26.433020 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-6afaa1f1-c1f0-4daa-a1e4-15055fd0e85d req-08282d6e-380f-4601-91f6-207e9ad961a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8", "tag": "ba413dd1-345c-421d-92ca-593eeaefc610"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:26.444586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-6afaa1f1-c1f0-4daa-a1e4-15055fd0e85d req-08282d6e-380f-4601-91f6-207e9ad961a4 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:26.445404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-6afaa1f1-c1f0-4daa-a1e4-15055fd0e85d req-08282d6e-380f-4601-91f6-207e9ad961a4 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:26.445920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-6afaa1f1-c1f0-4daa-a1e4-15055fd0e85d req-08282d6e-380f-4601-91f6-207e9ad961a4 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:26.457819 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-6afaa1f1-c1f0-4daa-a1e4-15055fd0e85d req-08282d6e-380f-4601-91f6-207e9ad961a4 service nova] Creating event network-changed:ba413dd1-345c-421d-92ca-593eeaefc610 for instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 on hv-cinder-84506 Oct 17 07:12:26.462706 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-6afaa1f1-c1f0-4daa-a1e4-15055fd0e85d req-08282d6e-380f-4601-91f6-207e9ad961a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Oct 17 07:12:26.463325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 586/1182] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 07:12:27.396105 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:27.396712 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:27.403377 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:27.403855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:27.404285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:27.404968 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:27.405413 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:27.405828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:27.641158 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:27.648725 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2df1133c-4685-4b82-9b4f-2273a88de2ad tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.257682 Oct 17 07:12:27.649288 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 597/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:27 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:28.058694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:28.059346 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:28.066681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:28.067237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:28.067694 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:28.068447 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:28.068902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:28.069327 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:28.091697 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lazy-loading 'flavor' on Instance uuid c06f20c4-d1f2-4a52-95de-dae8c232c555 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:12:28.163972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7f38df85-b88e-4c9c-b67a-9adc6a5512e7 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "POST /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555/action" status: 202 len: 0 microversion: 2.1 time: 0.110027 Oct 17 07:12:28.164551 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 587/1184] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:12:28 2022] POST /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:12:28.172716 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:28.173325 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:28.179908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:28.180544 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:28.180993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:28.181851 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:28.182304 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:28.182778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:28.311677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:28.320032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d203c4f4-ccc9-4f4f-84f0-f1084893565e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.151165 Oct 17 07:12:28.320585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 598/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:28 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:28.671287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:28.671986 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:28.678067 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:28.678538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:28.678965 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:28.679664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:28.680111 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:28.680529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:28.848373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:28.856034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1cf286b4-7a48-4b35-9c82-d0323fb1518a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.188982 Oct 17 07:12:28.856678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 588/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:28 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:12:29.343686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:29.344319 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:29.352778 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:29.353259 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:29.353687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:29.354376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:29.354819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:29.355353 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:29.492935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:29.501476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5a70d7ee-1462-4d7b-842a-bfc5f85f32ea tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.161465 Oct 17 07:12:29.502067 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 599/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:29 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:29.878867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:29.879494 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:29.885895 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:29.886363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:29.886791 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:29.887493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:29.887940 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:29.888354 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:30.017129 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:30.025194 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-49e31197-96e4-44e9-98e4-a76a09639d42 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.150304 Oct 17 07:12:30.025763 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 589/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:29 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:30.525917 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:30.526562 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:30.532943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:30.533450 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:30.533936 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:30.534668 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:30.535122 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:30.535569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:30.667419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:30.675701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fff3c36f-710f-409f-aa90-e9f325472086 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.154007 Oct 17 07:12:30.676266 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 600/1189] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:30 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:31.050363 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:31.050972 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:31.057174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:31.057700 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:31.058117 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:31.058800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:31.059274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:31.059698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:31.187791 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:31.195454 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-108927fe-a11d-4a83-96ed-8a67cfce91f7 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.149470 Oct 17 07:12:31.196025 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 590/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:31 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:31.698919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:31.699560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:31.706072 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:31.706555 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:31.706986 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:31.707704 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:31.708153 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:31.708570 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:31.801522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:31.834117 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:31.842279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-112dab84-14d7-42cf-87a6-886fa7c154fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.147392 Oct 17 07:12:31.842840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 601/1191] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:31 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:12:32.219473 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:32.220083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:32.222664 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:32.223341 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=6 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:32.229559 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:32.230034 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:32.230459 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:32.231134 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:32.231604 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:32.232018 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:32.358852 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:32.366462 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-617c2b5a-cf52-41aa-9f1f-224c2d7ddc2e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.150910 Oct 17 07:12:32.367019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 591/1192] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:32 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:32.866402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:32.867161 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:32.873968 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:32.874496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:32.874931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:32.875646 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:32.876102 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:32.876522 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:33.012183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:33.020504 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-41600337-b371-44e6-a2dd-628582579634 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.157880 Oct 17 07:12:33.021011 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 602/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:32 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:12:33.389385 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:33.389898 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:33.396421 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:33.396893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:33.397315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:33.397990 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:33.398432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:33.398847 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:33.524231 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:33.531889 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-fa1e76bb-e7cf-4d6d-b05a-fca7fc6f7b36 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.146406 Oct 17 07:12:33.532456 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 592/1194] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:33 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:34.043819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:34.044431 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:34.050954 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:34.051464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:34.051900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:34.052585 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:34.053037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:34.053456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:34.188805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:34.197109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2e70979f-7406-4550-a94a-b9d02231e926 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.157111 Oct 17 07:12:34.197670 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 603/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:34 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:34.554698 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:34.555370 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:34.561940 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:34.562411 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:34.562838 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:34.563540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:34.563982 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:34.564395 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:34.697741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:34.706062 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-d5a08c59-fc64-49a4-8ce6-3eb960a44053 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.155429 Oct 17 07:12:34.707491 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 593/1196] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:34 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:35.220294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:35.220943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:35.227308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:35.227732 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:35.228169 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:35.228854 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:35.229310 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:35.229733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:35.356642 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:35.364886 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c54e1a9e-89db-48b8-b4bc-ee69b93f6836 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.148466 Oct 17 07:12:35.365452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 604/1197] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:35 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:35.728726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:35.729322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:35.735765 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:35.736251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:35.736681 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:35.737373 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:35.737822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:35.738273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:35.869970 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:35.877523 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f7209d76-73dc-4a67-bd48-046bd12d1dc3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.152636 Oct 17 07:12:35.878083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 594/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:35 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:36.387918 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:36.388557 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:36.395666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:36.396146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:36.396584 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:36.397270 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:36.397724 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:36.398144 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:36.526030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:36.533740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-df68e047-bf0a-45fc-a3ff-a614737dc64a tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.149966 Oct 17 07:12:36.534299 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 605/1199] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:36 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:36.711249 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-ef687e96-ccc0-4d31-9145-144bcf44a008 req-204ffb42-8f1e-4dee-aa2a-2d33a9064aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8", "name": "network-vif-plugged", "status": "completed", "tag": "ba413dd1-345c-421d-92ca-593eeaefc610"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:36.721105 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-ef687e96-ccc0-4d31-9145-144bcf44a008 req-204ffb42-8f1e-4dee-aa2a-2d33a9064aef service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:36.721721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-ef687e96-ccc0-4d31-9145-144bcf44a008 req-204ffb42-8f1e-4dee-aa2a-2d33a9064aef service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:36.722690 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-ef687e96-ccc0-4d31-9145-144bcf44a008 req-204ffb42-8f1e-4dee-aa2a-2d33a9064aef service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:36.734934 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-ef687e96-ccc0-4d31-9145-144bcf44a008 req-204ffb42-8f1e-4dee-aa2a-2d33a9064aef service nova] Creating event network-vif-plugged:ba413dd1-345c-421d-92ca-593eeaefc610 for instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 on hv-cinder-84506 Oct 17 07:12:36.739976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-ef687e96-ccc0-4d31-9145-144bcf44a008 req-204ffb42-8f1e-4dee-aa2a-2d33a9064aef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033093 Oct 17 07:12:36.740573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 595/1200] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:12:36.901093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:36.901863 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:36.907800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:36.908285 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:36.908719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:36.909409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:36.909935 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:36.910361 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:37.097306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:37.104971 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-24582f3a-fb03-4630-aac5-835b1f9e5cae tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.208165 Oct 17 07:12:37.105531 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 606/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:36 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:37.558515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:37.559237 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:37.565382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:37.565904 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:37.566337 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:37.567022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:37.567510 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:37.567935 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:37.700154 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:37.707886 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c11d410a-38c1-42d3-ae42-0191fcc157fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.153661 Oct 17 07:12:37.708464 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 596/1202] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:37 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:38.127196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:38.127822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:38.134380 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:38.134865 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:38.135334 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:38.136030 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:38.136484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:38.136940 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:38.265668 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:38.273896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d7170512-e49b-4688-b5eb-0ae16a727da2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1263 microversion: 2.1 time: 0.150533 Oct 17 07:12:38.274453 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 607/1203] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:38 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:38.731419 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:38.732191 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:38.739264 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:38.739811 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:38.740239 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:38.740922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:38.741366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:38.741780 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:38.927955 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:38.935637 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9063723f-7316-4e7a-9c64-d12435e773fd tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.208224 Oct 17 07:12:38.936218 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 597/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:38 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:39.296833 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:39.297366 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:39.304362 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:39.304843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:39.305274 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:39.305960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:39.306417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:39.306840 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:39.436224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:39.443927 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-da7003cb-a86d-4389-b1f7-94770d8454cc tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1449 microversion: 2.1 time: 0.151098 Oct 17 07:12:39.444480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 608/1205] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:39 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:39.466202 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:39.466802 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:39.473265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:39.473752 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:39.474163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:39.475185 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:39.475666 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:39.476082 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:39.601844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:39.609787 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bf098c85-4967-4fb3-9d87-0d9345fb8564 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1449 microversion: 2.1 time: 0.147344 Oct 17 07:12:39.610350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 598/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:39 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:39.959994 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:39.960601 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:39.966324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:39.966807 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:39.967263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:39.967955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:39.968402 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:39.968815 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:40.176931 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:40.188328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7ab197a2-900c-4c0f-b0ca-5a18adbccb65 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.232637 Oct 17 07:12:40.198898 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 609/1207] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:39 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:41.214908 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:41.216184 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:41.223169 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:41.223932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:41.224563 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:41.225265 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:41.225714 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:41.226136 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:41.244627 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:41.427088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:41.435130 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0fb08410-54fb-4844-807a-ee06c4c32319 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1567 microversion: 2.1 time: 0.225291 Oct 17 07:12:41.435932 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 599/1208] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:41 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:41.460264 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:41.461567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:41.468552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:41.469116 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:41.469600 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:41.470508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:41.475506 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-8cf076b0-544d-4237-8c80-396454f01983 req-c9d1e25e-a32d-475b-a1b3-cb6049beb825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8", "tag": "ba413dd1-345c-421d-92ca-593eeaefc610"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:41.481810 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:41.482256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:41.485152 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8cf076b0-544d-4237-8c80-396454f01983 req-c9d1e25e-a32d-475b-a1b3-cb6049beb825 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:41.485634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8cf076b0-544d-4237-8c80-396454f01983 req-c9d1e25e-a32d-475b-a1b3-cb6049beb825 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:41.486084 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-8cf076b0-544d-4237-8c80-396454f01983 req-c9d1e25e-a32d-475b-a1b3-cb6049beb825 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:41.497877 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-8cf076b0-544d-4237-8c80-396454f01983 req-c9d1e25e-a32d-475b-a1b3-cb6049beb825 service nova] Creating event network-changed:ba413dd1-345c-421d-92ca-593eeaefc610 for instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 on hv-cinder-84506 Oct 17 07:12:41.505493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-8cf076b0-544d-4237-8c80-396454f01983 req-c9d1e25e-a32d-475b-a1b3-cb6049beb825 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033385 Oct 17 07:12:41.506446 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 600/1209] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:12:41.516102 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118995) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 07:12:41.576788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:41.603846 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [251bc525-5c4d-4e8f-9e3d-ca6831235992] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 07:12:42.610520 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [251bc525-5c4d-4e8f-9e3d-ca6831235992] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58626. Oct 17 07:12:42.614308 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-79ba2927-b717-41b1-8145-1dd633529dc0 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "POST /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555/action" status: 202 len: 0 microversion: 2.1 time: 1.158875 Oct 17 07:12:42.614989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 610/1210] 10.222.0.36 () {60 vars in 1278 bytes} [Mon Oct 17 07:12:41 2022] POST /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555/action => generated 0 bytes in 1160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:12:42.623620 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:42.624351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:42.631254 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:42.631749 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:42.632180 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:42.632875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:42.633367 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:42.633841 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:42.786366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:42.794100 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5ed1f231-d7cd-4bd1-b7a9-86f3fb5eeaec tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1515 microversion: 2.1 time: 0.174816 Oct 17 07:12:42.794767 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 601/1211] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:42 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:43.817596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:43.818208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:43.824231 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:43.825003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:43.825439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:43.826151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:43.826602 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:43.827050 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:43.959589 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:43.967198 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c4aa99fa-079a-42e9-acb0-73dc94b81485 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1515 microversion: 2.1 time: 0.153928 Oct 17 07:12:43.967781 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 611/1212] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:43 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:44.836545 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-2f7b1784-2dba-4ec1-bf64-166f5bc690c8 req-d875c934-0818-4fd0-a944-3f0fd3e3ed4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "name": "network-vif-unplugged", "status": "completed", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:44.846599 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2f7b1784-2dba-4ec1-bf64-166f5bc690c8 req-d875c934-0818-4fd0-a944-3f0fd3e3ed4d service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:44.847829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2f7b1784-2dba-4ec1-bf64-166f5bc690c8 req-d875c934-0818-4fd0-a944-3f0fd3e3ed4d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:44.848257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-2f7b1784-2dba-4ec1-bf64-166f5bc690c8 req-d875c934-0818-4fd0-a944-3f0fd3e3ed4d service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:44.861196 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.compute.server_external_events [req-2f7b1784-2dba-4ec1-bf64-166f5bc690c8 req-d875c934-0818-4fd0-a944-3f0fd3e3ed4d service nova] Unable to find a host for instance c06f20c4-d1f2-4a52-95de-dae8c232c555. Dropping event network-vif-unplugged {{(pid=118996) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 07:12:44.862076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-2f7b1784-2dba-4ec1-bf64-166f5bc690c8 req-d875c934-0818-4fd0-a944-3f0fd3e3ed4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029466 Oct 17 07:12:44.862736 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 602/1213] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 07:12:44.990843 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:44.991476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:44.998278 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:44.998761 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:44.999191 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:44.999904 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:45.000349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:45.000786 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:45.130852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:45.139390 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-784f40c6-534b-4118-904b-59a6fc13aa0f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1515 microversion: 2.1 time: 0.153057 Oct 17 07:12:45.140058 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 612/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:44 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:46.163566 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:46.164183 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:46.170536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:46.171011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:46.171485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:46.172177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:46.172614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:46.173035 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:46.298917 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:46.306758 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4b1ab05c-99a9-4302-8b0f-6e89b1a1ae33 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1515 microversion: 2.1 time: 0.147604 Oct 17 07:12:46.307347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 603/1215] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:46 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:47.329944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:47.330567 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:47.337328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:47.337826 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:47.338256 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:47.338955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:47.339442 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:47.339868 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:47.474075 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:47.481672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c7c23306-fb85-4036-8c93-9c5a124b3e77 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1517 microversion: 2.1 time: 0.155541 Oct 17 07:12:47.482233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 613/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:47 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:48.505818 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:48.506430 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:48.513432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:48.514049 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:48.514485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:48.515236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:48.515703 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:48.516126 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:48.723437 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:48.731138 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ca2ed104-e24d-45b5-9d77-8cca1f22b82b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.229789 Oct 17 07:12:48.731731 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 604/1217] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:48 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:49.755345 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:49.755956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:49.762552 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:49.763130 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:49.763606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:49.764294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:49.764745 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:49.765169 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:49.896877 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:49.904726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-670b6c2d-5837-41f7-bf4c-5a1f8c4ce0a1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.153669 Oct 17 07:12:49.905284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 614/1218] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:49 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:50.926908 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:50.927547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:50.934166 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:50.934653 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:50.935088 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:50.935801 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:50.936257 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:50.936682 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:51.063632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:51.071710 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-44572779-3f29-40b3-a864-04e1c155b84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.148724 Oct 17 07:12:51.072273 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 605/1219] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:50 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:52.095282 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:52.095895 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:52.098804 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:52.104110 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:52.104592 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:52.105028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:52.105754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:52.106208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:52.106628 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:52.240039 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:52.247666 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-10a58373-d15f-4132-949a-f5ba3554207e tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.156298 Oct 17 07:12:52.248224 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 615/1220] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:52 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:53.269867 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:53.270435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:53.272996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:12:53.278795 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:53.279289 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:53.279716 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:53.280387 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:53.280829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:53.281243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:53.409790 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:53.417438 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0d0f1a2d-9b7b-4431-81f4-f5721b44e79d tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.151503 Oct 17 07:12:53.418006 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 606/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:53 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:54.441025 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:54.441527 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:54.447944 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:54.448426 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:54.448862 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:54.449548 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:54.450267 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:54.450688 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:54.578814 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:54.587008 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6ba29c7c-0f5f-437e-91c9-0b33faed8046 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.150002 Oct 17 07:12:54.587595 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 616/1222] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:54 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:55.610372 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:55.610988 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:55.618076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:55.618559 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:55.618994 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:55.619713 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:55.620167 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:55.620590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:55.752092 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:55.759876 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-091f5a3f-595d-460b-bfee-5291adeeb84b tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.153436 Oct 17 07:12:55.760449 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 607/1223] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:55 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:56.783220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:56.783850 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:56.790945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:56.791466 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:56.791908 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:56.792606 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:56.793063 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:56.793486 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:57.037822 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:57.045622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2d55c1d4-add0-4dd4-8104-2d9ecec5995c tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.266376 Oct 17 07:12:57.046202 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 617/1224] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:56 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:12:58.069711 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:58.070256 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:58.076921 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:58.077407 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:58.077844 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:58.078537 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:58.078997 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:58.079458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:58.263644 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:58.271846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b496dde9-320f-4a7b-afcf-c7b42736e0cb tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.206558 Oct 17 07:12:58.272418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 608/1225] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:58 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:12:58.819738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-cd3a183d-2ef2-44e5-b6fe-c3f7e2a165bc req-0d71ada4-cb8b-40ab-ae12-a3e48f6183e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "name": "network-vif-plugged", "status": "completed", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:12:58.830946 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cd3a183d-2ef2-44e5-b6fe-c3f7e2a165bc req-0d71ada4-cb8b-40ab-ae12-a3e48f6183e8 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:58.831546 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cd3a183d-2ef2-44e5-b6fe-c3f7e2a165bc req-0d71ada4-cb8b-40ab-ae12-a3e48f6183e8 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:58.832648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cd3a183d-2ef2-44e5-b6fe-c3f7e2a165bc req-0d71ada4-cb8b-40ab-ae12-a3e48f6183e8 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:58.844515 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-cd3a183d-2ef2-44e5-b6fe-c3f7e2a165bc req-0d71ada4-cb8b-40ab-ae12-a3e48f6183e8 service nova] Creating event network-vif-plugged:e3bd85c0-a0fd-4b86-940e-1ba4d645601f for instance c06f20c4-d1f2-4a52-95de-dae8c232c555 on hv-cinder-84506 Oct 17 07:12:58.849773 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-cd3a183d-2ef2-44e5-b6fe-c3f7e2a165bc req-0d71ada4-cb8b-40ab-ae12-a3e48f6183e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Oct 17 07:12:58.850578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 618/1226] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:12:59.295359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:12:59.295979 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:12:59.302897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:59.303418 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:59.303856 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:59.304547 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:12:59.305002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:12:59.305425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:12:59.434995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:12:59.442800 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-7d34c32d-5fed-4259-aaa3-3d8bb29d6090 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.151340 Oct 17 07:12:59.443400 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 609/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:12:59 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:13:00.466488 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:13:00.467279 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:13:00.473789 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:13:00.474263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:13:00.474911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:13:00.475615 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:13:00.476060 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:13:00.476484 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:13:00.604819 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:13:00.614335 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4ffe8075-51f1-4c9e-aaac-b32eba2fa006 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1573 microversion: 2.1 time: 0.152060 Oct 17 07:13:00.614883 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 619/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:13:00 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:13:01.637967 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:13:01.638609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:13:01.645207 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:13:01.645678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:13:01.646109 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:13:01.646785 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:13:01.647243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:13:01.647660 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:13:01.775347 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:13:01.783037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5e444c94-ead8-4207-a30d-45407c8ff795 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1560 microversion: 2.1 time: 0.148946 Oct 17 07:13:01.783658 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 610/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:13:01 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:18.216556 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=9 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:18.217696 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:18.218104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=60 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:18.218208 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:18.218585 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:14:18.218766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Mon Oct 17 07:14:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 17 07:14:18.223096 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=9 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:18.224233 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:18.235922 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:18.236411 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:18.236844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:18.237543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:18.237993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:18.238408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:18.269543 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:14:18.285766 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-9afa54da-eca0-4052-8a98-e7f8f9dd4527 req-02c3a9c7-bea0-406d-8319-6863e1fdf2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:18.296022 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9afa54da-eca0-4052-8a98-e7f8f9dd4527 req-02c3a9c7-bea0-406d-8319-6863e1fdf2b1 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:18.296500 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9afa54da-eca0-4052-8a98-e7f8f9dd4527 req-02c3a9c7-bea0-406d-8319-6863e1fdf2b1 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:18.296922 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9afa54da-eca0-4052-8a98-e7f8f9dd4527 req-02c3a9c7-bea0-406d-8319-6863e1fdf2b1 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:18.308850 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-9afa54da-eca0-4052-8a98-e7f8f9dd4527 req-02c3a9c7-bea0-406d-8319-6863e1fdf2b1 service nova] Creating event network-changed:e3bd85c0-a0fd-4b86-940e-1ba4d645601f for instance c06f20c4-d1f2-4a52-95de-dae8c232c555 on hv-cinder-84506 Oct 17 07:14:18.314361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-9afa54da-eca0-4052-8a98-e7f8f9dd4527 req-02c3a9c7-bea0-406d-8319-6863e1fdf2b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099488 Oct 17 07:14:18.315148 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 611/1230] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:14:18.348240 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e660e4db-c2e9-4281-985c-d3bc99d1dd00 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 204 len: 0 microversion: 2.1 time: 0.136491 Oct 17 07:14:18.348752 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 620/1231] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:14:18 2022] DELETE /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:14:18.358881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:18.359719 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:18.366244 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:18.366822 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:18.367377 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:18.368168 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:18.369068 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:18.369496 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:18.512846 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:18.520833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a7e119b9-afdf-4ddb-81ef-a51abfc9511f tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.167502 Oct 17 07:14:18.521490 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 612/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:18 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:14:19.544828 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:19.545524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:19.551945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:19.552424 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:19.552855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:19.553541 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:19.554013 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:19.554430 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:19.685496 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:19.693738 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bb87d1ae-c9fe-4187-8dba-ced20ab10fe3 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1566 microversion: 2.1 time: 0.153227 Oct 17 07:14:19.694302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 621/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:19 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:20.717090 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:20.717726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:20.724583 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:20.725071 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:20.725499 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:20.726226 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:20.726675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:20.727094 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:20.909687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:20.917497 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-28ada370-da05-4929-83fb-79234ff8afb1 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1448 microversion: 2.1 time: 0.204858 Oct 17 07:14:20.918074 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 613/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:20 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1448 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:21.016280 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-cb32e43f-5b78-4a7e-a845-f85ca167e539 req-0123c456-3c6a-4bb6-a4b6-0e1159bff6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06f20c4-d1f2-4a52-95de-dae8c232c555", "name": "network-vif-deleted", "tag": "e3bd85c0-a0fd-4b86-940e-1ba4d645601f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:21.028736 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cb32e43f-5b78-4a7e-a845-f85ca167e539 req-0123c456-3c6a-4bb6-a4b6-0e1159bff6ed service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:21.029207 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cb32e43f-5b78-4a7e-a845-f85ca167e539 req-0123c456-3c6a-4bb6-a4b6-0e1159bff6ed service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:21.029664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cb32e43f-5b78-4a7e-a845-f85ca167e539 req-0123c456-3c6a-4bb6-a4b6-0e1159bff6ed service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:21.040812 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-cb32e43f-5b78-4a7e-a845-f85ca167e539 req-0123c456-3c6a-4bb6-a4b6-0e1159bff6ed service nova] Creating event network-vif-deleted:e3bd85c0-a0fd-4b86-940e-1ba4d645601f for instance c06f20c4-d1f2-4a52-95de-dae8c232c555 on hv-cinder-84506 Oct 17 07:14:21.047003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-cb32e43f-5b78-4a7e-a845-f85ca167e539 req-0123c456-3c6a-4bb6-a4b6-0e1159bff6ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Oct 17 07:14:21.047622 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 622/1235] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:14:21.940655 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:21.941274 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:21.948051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:21.948634 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:21.949849 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:21.950598 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:21.951011 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:21.951452 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:21.982143 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:21.982643 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:21.983072 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:21.983659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lazy-loading 'fault' on Instance uuid c06f20c4-d1f2-4a52-95de-dae8c232c555 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:14:22.029754 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a8022fa3543b2a0ce0cdfc1512f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3326642f5c9e4103aa3c72f47b5d23b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:22.036900 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-9bbe3425-19b0-4200-a671-30c42e129640 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 200 len: 1178 microversion: 2.1 time: 0.100150 Oct 17 07:14:22.037485 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 614/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:21 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 1178 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:23.060478 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:23.061172 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] [instance: c06f20c4-d1f2-4a52-95de-dae8c232c555] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:23.067901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:23.068387 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:23.068820 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:23.069515 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:23.069969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:23.070393 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:23.084780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] HTTP exception thrown: Instance c06f20c4-d1f2-4a52-95de-dae8c232c555 could not be found. Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Request method failure captured: Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 HTTP/1.1 Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTP-dsKgjOFZoe_eNMoI4jEecNmezyvBp9Na8YNE0PK1_PPKRfIDJYADeOCouhMdk7w-sRXUPiDwvKU9sZWJ9zawN1hf4oeQ16CrvwaHfPTc3eQST9B5zZvk_7jTBlDmyjll-aKgZ8upcXhlHEY8fC8EGHUxS1J7-b7G0WWVjeLPh8vA Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 3326642f5c9e4103aa3c72f47b5d23b5 Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestShelveInstance-359567651 Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:14:23.086476 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3326642f5c9e4103aa3c72f47b5d23b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3326642f5c9e4103aa3c72f47b5d23b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3326642f5c9e4103aa3c72f47b5d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3326642f5c9e4103aa3c72f47b5d23b5"}]}] Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestShelveInstance-359567651 Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 3326642f5c9e4103aa3c72f47b5d23b5 Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestShelveInstance-359567651 Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-TestShelveInstance-359567651-project Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 455a8022fa3543b2a0ce0cdfc1512f73 Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestShelveInstance-359567651-project Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance c06f20c4-d1f2-4a52-95de-dae8c232c555 could not be found. Oct 17 07:14:23.088305 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'c06f20c4-d1f2-4a52-95de-dae8c232c555'} Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06f20c4-d1f2-4a52-95de-dae8c232c555 could not be found. Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:14:23.089817 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06f20c4-d1f2-4a52-95de-dae8c232c555 could not be found. Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06f20c4-d1f2-4a52-95de-dae8c232c555 could not be found. Oct 17 07:14:23.091295 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:14:23.092528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Returning 404 to user: Instance c06f20c4-d1f2-4a52-95de-dae8c232c555 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:14:23.092528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8fa29ea7-6058-4844-87bb-a147a0359d79 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555" status: 404 len: 111 microversion: 2.1 time: 0.032090 Oct 17 07:14:23.092528 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 623/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:23 2022] GET /compute/v2.1/servers/c06f20c4-d1f2-4a52-95de-dae8c232c555 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:14:23.249188 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-bf4cf97d-3cab-4ea5-bac5-45cc60b334e9 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] Calling method '.version_select at 0x7f4acd052ca0>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:23.271842 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-bf4cf97d-3cab-4ea5-bac5-45cc60b334e9 tempest-TestShelveInstance-359567651 tempest-TestShelveInstance-359567651-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1294755818" status: 202 len: 0 microversion: 2.1 time: 0.026556 Oct 17 07:14:23.272575 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 615/1238] 10.222.0.36 () {58 vars in 1254 bytes} [Mon Oct 17 07:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1294755818 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 07:14:36.590508 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:36.591051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:36.593263 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:36.593901 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:36.599687 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:36.600171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:36.600598 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:36.601282 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:36.601731 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:36.602151 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:36.630182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:14:36.704575 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0d26247c-ec4d-419a-b013-c16a5a54eff9 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 204 len: 0 microversion: 2.1 time: 0.117737 Oct 17 07:14:36.708468 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 624/1239] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:14:36 2022] DELETE /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:14:36.711361 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=22 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:36.712240 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:36.716509 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:36.717123 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:36.725283 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:36.725761 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:36.726193 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:36.726875 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:36.727366 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:36.727788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:36.858399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:36.866056 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f43627e3-e6f8-44fe-a38b-caf0f34aa71b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1574 microversion: 2.1 time: 0.156352 Oct 17 07:14:36.866616 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 616/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:36 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:37.890989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:37.891723 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:37.894039 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:14:37.894188 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Mon Oct 17 07:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 (ip 10.222.0.36) !!! Oct 17 07:14:37.902328 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:37.902813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:37.903272 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:37.903989 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:37.904436 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:37.904855 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:38.035869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:38.043524 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-69cc19ce-c942-4369-a17a-3e2680c6dc6f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1574 microversion: 2.1 time: 0.157360 Oct 17 07:14:38.044643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 625/1241] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:37 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:39.066987 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:39.067627 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:39.074129 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:39.074602 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:39.075958 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:39.076654 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:39.077102 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:39.077517 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:39.322885 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:39.331521 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-4e782044-9649-429a-aa75-c2bfba720734 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 200 len: 1574 microversion: 2.1 time: 0.268373 Oct 17 07:14:39.332106 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 617/1242] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:39 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 1574 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:39.514294 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-8756bfc9-e17d-4397-b1b4-e811994e8aba req-960b06be-1ca9-450b-bf2a-b0519e7869cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8", "name": "network-vif-deleted", "tag": "ba413dd1-345c-421d-92ca-593eeaefc610"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:39.527316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8756bfc9-e17d-4397-b1b4-e811994e8aba req-960b06be-1ca9-450b-bf2a-b0519e7869cc service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:39.527483 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8756bfc9-e17d-4397-b1b4-e811994e8aba req-960b06be-1ca9-450b-bf2a-b0519e7869cc service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:39.527780 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8756bfc9-e17d-4397-b1b4-e811994e8aba req-960b06be-1ca9-450b-bf2a-b0519e7869cc service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:39.541703 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-8756bfc9-e17d-4397-b1b4-e811994e8aba req-960b06be-1ca9-450b-bf2a-b0519e7869cc service nova] Creating event network-vif-deleted:ba413dd1-345c-421d-92ca-593eeaefc610 for instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 on hv-cinder-84506 Oct 17 07:14:39.548175 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-8756bfc9-e17d-4397-b1b4-e811994e8aba req-960b06be-1ca9-450b-bf2a-b0519e7869cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037418 Oct 17 07:14:39.549209 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 626/1243] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:14:40.354640 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:40.355002 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:40.361941 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:40.362777 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:40.363231 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:40.363945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:40.364398 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:40.364824 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:40.379050 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] HTTP exception thrown: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Request method failure captured: Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 HTTP/1.1 Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTQA5VRChkvroiC4URPsAxs-_jOouHQf_0rU0wNfG39ooKz8XUb1YfQpi18sP9pUR1WnVa6tKmvpVNfIH-CcN4XHB_DszgjC9ZAfY3vTDVpuJq6O6yv-n-zGuH0Ekw9SMDlQiGyXSZti_zgh_J6DsiJbaZJnVkdK62nWW8DkPe3abo2o Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:14:40.380823 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27c9c9c8efd64131b5944c5cf47553b3"}]}] Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-TestVolumeBootPattern-386979739 Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 2dda9b6c5edd4dec87e4d23ecfcea5e9 Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:14:40.382540 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8'} Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:14:40.383695 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:14:40.386051 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:14:40.389052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Returning 404 to user: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:14:40.389052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-e1f2d65b-3b52-4cd6-82d2-05543a8d4a0e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 404 len: 111 microversion: 2.1 time: 0.032112 Oct 17 07:14:40.389052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 618/1244] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:40 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 07:14:40.482210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-892939644", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-3037217", "security_groups": [{"name": "tempest-secgroup-smoke-1984779673"}], "block_device_mapping_v2": [{"uuid": "4125d402-2fc4-4c49-922b-6d79550c69d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb86a052-14f2-4094-bbba-a8fec1a4a781"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:40.599032 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] validate_networks() for [('cb86a052-14f2-4094-bbba-a8fec1a4a781', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:14:41.060569 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:14:41.060987 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:14:41.061452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:14:41.061856 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:14:41.062260 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:14:41.071223 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:41.071719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:41.072147 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:41.072860 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:41.073464 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:41.073882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:41.091659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:14:41.095541 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for user 2dda9b6c5edd4dec87e4d23ecfcea5e9 and project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:14:41.150222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:14:41.152460 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4125d402-2fc4-4c49-922b-6d79550c69d5',volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:14:41.279756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fd464aff-fcae-479f-86c3-783be2c377eb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.802027 Oct 17 07:14:41.280395 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 627/1245] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:14:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 07:14:41.291514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-1e77c200-2fcf-4202-88cd-dd62553c337c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:41.292295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-1e77c200-2fcf-4202-88cd-dd62553c337c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:41.347741 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-1e77c200-2fcf-4202-88cd-dd62553c337c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:41.354573 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-1e77c200-2fcf-4202-88cd-dd62553c337c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1091 microversion: 2.1 time: 0.067066 Oct 17 07:14:41.355142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 619/1246] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:41 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1091 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:42.377897 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:42.378435 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:42.384684 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:42.385171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:42.385608 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:42.386302 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:42.386759 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:42.387185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:42.448511 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:42.456806 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c07f1b8e-f2b0-461a-bbfb-d6e9a809107a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1189 microversion: 2.1 time: 0.083941 Oct 17 07:14:42.457482 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 628/1247] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:42 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1189 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:43.479799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:43.480605 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:43.488493 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:43.489076 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:43.489570 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:43.490344 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:43.490862 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:43.491383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:43.712968 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:43.720761 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-f3ec0196-a7c6-4db0-875c-41809fdbd4d4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.244810 Oct 17 07:14:43.721349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 620/1248] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:43 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:43.908506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-c64564f1-28d0-4c4b-acc5-bfbeb32c3643 req-c422b137-00d0-4d80-8bb6-86aeeb9a4f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53856c-492c-4131-93b7-cf4a4f1fe317", "tag": "d70249d5-64f1-4af2-b4a5-bd513d30d8d3"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:43.919268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-c64564f1-28d0-4c4b-acc5-bfbeb32c3643 req-c422b137-00d0-4d80-8bb6-86aeeb9a4f2f service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:43.920596 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-c64564f1-28d0-4c4b-acc5-bfbeb32c3643 req-c422b137-00d0-4d80-8bb6-86aeeb9a4f2f service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:43.921215 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-c64564f1-28d0-4c4b-acc5-bfbeb32c3643 req-c422b137-00d0-4d80-8bb6-86aeeb9a4f2f service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:43.932342 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-c64564f1-28d0-4c4b-acc5-bfbeb32c3643 req-c422b137-00d0-4d80-8bb6-86aeeb9a4f2f service nova] Creating event network-changed:d70249d5-64f1-4af2-b4a5-bd513d30d8d3 for instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 on hv-cinder-84506 Oct 17 07:14:43.937775 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-c64564f1-28d0-4c4b-acc5-bfbeb32c3643 req-c422b137-00d0-4d80-8bb6-86aeeb9a4f2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032981 Oct 17 07:14:43.938919 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 629/1249] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:14:44.743668 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:44.744443 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:44.751096 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:44.751611 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:44.752052 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:44.752738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:44.753189 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:44.753609 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:44.963524 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:44.972132 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-0e098e80-1e3f-4a20-ba84-120bc302371c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.232342 Oct 17 07:14:44.973203 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 621/1250] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:44 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:46.008956 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:46.009672 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:46.015751 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:46.016244 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:46.016665 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:46.017338 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:46.017784 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:46.018199 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:46.143977 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:46.151691 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7272c6e5-a7d0-4763-9e00-68842787ba3b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.147267 Oct 17 07:14:46.152317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 630/1251] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:46 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:47.173860 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:47.174472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:47.180881 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:47.181352 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:47.181778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:47.182458 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:47.182902 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:47.183351 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:47.313383 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:47.321104 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-71d79fa8-380c-44c0-a6c7-423fc8bec70f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.151152 Oct 17 07:14:47.321678 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 622/1252] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:47 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:48.344985 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:48.345561 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:48.352028 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:48.352509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:48.352945 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:48.353636 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:48.354087 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:48.354509 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:48.483754 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:48.491439 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f73b495f-8911-4e34-80e5-eec9cff4790e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.150894 Oct 17 07:14:48.492003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 631/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:48 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:49.513883 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:49.514486 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:49.520914 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:49.521393 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:49.521820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:49.522499 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:49.522945 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:49.523399 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:49.650445 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:49.658479 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-555b5f7b-4c9d-4f8e-9126-1545be171e32 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.148504 Oct 17 07:14:49.659042 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 623/1254] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:49 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:50.681313 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:50.681943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:50.689232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:50.689748 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:50.690287 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:50.691003 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:50.691480 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:50.691905 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:50.822142 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:50.830251 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9bdd7acc-b1fa-42b3-a6e9-c5c76a05e7d8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.152835 Oct 17 07:14:50.830808 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 632/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:50 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:51.852574 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:51.853277 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:51.855675 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:51.861388 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:51.861872 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:51.862302 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:51.862993 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:51.863474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:51.863897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:51.993708 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:52.001996 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-8e09676d-c101-4903-a9f0-cccb3c6036a8 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.153437 Oct 17 07:14:52.002596 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 624/1256] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:51 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:53.024963 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:53.025560 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:53.027679 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:53.028399 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:14:53.035382 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:53.035859 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:53.036289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:53.036969 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:53.037415 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:53.037831 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:53.172429 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:53.181081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3facf944-0345-43cd-b7c8-5b917a570e5f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.159947 Oct 17 07:14:53.181695 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 633/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:53 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:53.539596 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-dfc4ee4a-c6a3-4dfd-b611-876e1a466d58 req-7b4f39cb-cde7-425d-a065-24eebcf9bb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53856c-492c-4131-93b7-cf4a4f1fe317", "name": "network-vif-plugged", "status": "completed", "tag": "d70249d5-64f1-4af2-b4a5-bd513d30d8d3"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:53.548889 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-dfc4ee4a-c6a3-4dfd-b611-876e1a466d58 req-7b4f39cb-cde7-425d-a065-24eebcf9bb62 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:53.549355 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-dfc4ee4a-c6a3-4dfd-b611-876e1a466d58 req-7b4f39cb-cde7-425d-a065-24eebcf9bb62 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:53.549774 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-dfc4ee4a-c6a3-4dfd-b611-876e1a466d58 req-7b4f39cb-cde7-425d-a065-24eebcf9bb62 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:53.562909 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-dfc4ee4a-c6a3-4dfd-b611-876e1a466d58 req-7b4f39cb-cde7-425d-a065-24eebcf9bb62 service nova] Creating event network-vif-plugged:d70249d5-64f1-4af2-b4a5-bd513d30d8d3 for instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 on hv-cinder-84506 Oct 17 07:14:53.568251 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-dfc4ee4a-c6a3-4dfd-b611-876e1a466d58 req-7b4f39cb-cde7-425d-a065-24eebcf9bb62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149219 Oct 17 07:14:53.568796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 625/1258] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:14:54.204838 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:54.205452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:54.211960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:54.212446 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:54.212881 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:54.213571 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:54.214029 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:54.214456 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:54.342232 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:54.350448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-18f06bc2-a3b7-4617-ab1d-ac6e69ada987 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1263 microversion: 2.1 time: 0.149750 Oct 17 07:14:54.351006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 634/1259] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:54 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:55.374686 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:55.375330 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:55.381416 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:55.381890 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:55.382322 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:55.383000 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:55.383474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:55.383892 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:55.516261 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:55.523980 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-840da618-ed2c-4067-93ff-174a82ae4408 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1449 microversion: 2.1 time: 0.154122 Oct 17 07:14:55.524536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 626/1260] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:55 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:55.545427 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:14:55.546109 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:14:55.552549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:55.553034 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:55.553473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:55.554165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:55.554624 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:55.555051 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:55.682082 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:14:55.690440 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-12e5cbb9-d00f-46c5-8e66-b46f87a83b4c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1449 microversion: 2.1 time: 0.148824 Oct 17 07:14:55.691006 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 635/1261] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:14:55 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:14:57.458614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-9f4c301c-100e-41e8-a866-1cfb02ab7d7e req-01012f80-b1c9-49c1-9c66-71c67db51886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53856c-492c-4131-93b7-cf4a4f1fe317", "tag": "d70249d5-64f1-4af2-b4a5-bd513d30d8d3"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:14:57.468836 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9f4c301c-100e-41e8-a866-1cfb02ab7d7e req-01012f80-b1c9-49c1-9c66-71c67db51886 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:14:57.469302 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9f4c301c-100e-41e8-a866-1cfb02ab7d7e req-01012f80-b1c9-49c1-9c66-71c67db51886 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:14:57.469721 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-9f4c301c-100e-41e8-a866-1cfb02ab7d7e req-01012f80-b1c9-49c1-9c66-71c67db51886 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:14:57.480424 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-9f4c301c-100e-41e8-a866-1cfb02ab7d7e req-01012f80-b1c9-49c1-9c66-71c67db51886 service nova] Creating event network-changed:d70249d5-64f1-4af2-b4a5-bd513d30d8d3 for instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 on hv-cinder-84506 Oct 17 07:14:57.485659 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-9f4c301c-100e-41e8-a866-1cfb02ab7d7e req-01012f80-b1c9-49c1-9c66-71c67db51886 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030625 Oct 17 07:14:57.486350 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 627/1262] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:16:33.701701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:33.702744 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:33.707681 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1180000166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-3037217", "security_groups": [{"name": "tempest-secgroup-smoke-1984779673"}], "block_device_mapping_v2": [{"uuid": "84127570-626b-4ad4-9576-fe8140c5cd1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb86a052-14f2-4094-bbba-a8fec1a4a781"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:16:33.819407 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] validate_networks() for [('cb86a052-14f2-4094-bbba-a8fec1a4a781', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 07:16:34.180352 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 07:16:34.180772 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 07:16:34.181245 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 07:16:34.181652 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 07:16:34.182059 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 07:16:34.190885 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:34.191409 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:34.191844 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:34.192568 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:34.193022 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:34.193440 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:34.210506 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 07:16:34.214408 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Getting quotas for user 2dda9b6c5edd4dec87e4d23ecfcea5e9 and project 27c9c9c8efd64131b5944c5cf47553b3. Resources: {'ram', 'cores', 'instances'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 07:16:34.269997 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 07:16:34.272171 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84127570-626b-4ad4-9576-fe8140c5cd1c',volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 07:16:34.401710 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-539141cc-c7f9-4bd7-9aca-5e2de125adfb tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701653 Oct 17 07:16:34.402349 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 636/1263] 10.222.0.36 () {60 vars in 1147 bytes} [Mon Oct 17 07:16:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 07:16:34.412590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=26 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:34.413332 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=54 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:34.414583 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:16:34.414745 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Mon Oct 17 07:16:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 (ip 10.222.0.36) !!! Oct 17 07:16:34.421037 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-b1a31c89-bdaf-4a5f-b634-a83a5a8c6485 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:34.421747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-b1a31c89-bdaf-4a5f-b634-a83a5a8c6485 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:34.477632 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-b1a31c89-bdaf-4a5f-b634-a83a5a8c6485 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:34.485472 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-b1a31c89-bdaf-4a5f-b634-a83a5a8c6485 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1092 microversion: 2.1 time: 0.075018 Oct 17 07:16:34.486043 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 628/1264] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:34 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:35.509869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:35.510425 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:35.516960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:35.517449 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:35.517880 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:35.518574 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:35.519184 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:35.519648 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:35.594165 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:35.602324 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-79b53939-00ef-4ae7-9b56-68e20e362b9a tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1208 microversion: 2.1 time: 0.097455 Oct 17 07:16:35.602882 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 637/1265] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:35 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:36.626440 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:36.627683 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:36.634722 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:36.635191 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:36.635646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:36.636339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:36.636792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:36.637214 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:36.824295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:36.832255 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-18109f41-5c06-481c-988c-9da53922fe99 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.210509 Oct 17 07:16:36.832912 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 629/1266] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:36 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:36.923234 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-9bae42b9-ad65-44ce-bd0c-97c609f856ae req-a7ec0095-2d0d-4d0d-8848-6a7eb2325f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6", "tag": "6969833b-ce6c-437c-8a7e-9119cf23f8e6"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:16:36.934457 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9bae42b9-ad65-44ce-bd0c-97c609f856ae req-a7ec0095-2d0d-4d0d-8848-6a7eb2325f99 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:36.935095 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9bae42b9-ad65-44ce-bd0c-97c609f856ae req-a7ec0095-2d0d-4d0d-8848-6a7eb2325f99 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:36.935653 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9bae42b9-ad65-44ce-bd0c-97c609f856ae req-a7ec0095-2d0d-4d0d-8848-6a7eb2325f99 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:36.947137 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-9bae42b9-ad65-44ce-bd0c-97c609f856ae req-a7ec0095-2d0d-4d0d-8848-6a7eb2325f99 service nova] Creating event network-changed:6969833b-ce6c-437c-8a7e-9119cf23f8e6 for instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 on hv-cinder-84506 Oct 17 07:16:36.951955 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-9bae42b9-ad65-44ce-bd0c-97c609f856ae req-a7ec0095-2d0d-4d0d-8848-6a7eb2325f99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 Oct 17 07:16:36.952803 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 638/1267] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:16:37.855176 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:37.855806 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:37.862142 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:37.862614 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:37.863066 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:37.863771 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:37.864219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:37.864633 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:38.330081 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:38.337670 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-ddb7d0f2-909e-4fc3-a334-738032e5aeca tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.486311 Oct 17 07:16:38.338236 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 630/1268] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:37 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:39.362376 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:39.363081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:39.369316 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:39.369733 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:39.370160 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:39.370837 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:39.371317 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:39.371756 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:39.504532 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:39.512657 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f5fac5ce-1379-4b7d-917f-b62727e8f8b4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.155602 Oct 17 07:16:39.513211 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 639/1269] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:39 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:40.536282 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:40.536834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:40.543260 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:40.543744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:40.544177 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:40.544858 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:40.545308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:40.545726 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:40.674557 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:40.682221 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-a6d7f9f8-396a-4c47-bb2b-d48c0e458f50 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.150393 Oct 17 07:16:40.682784 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 631/1270] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:40 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:41.704417 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:41.705014 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:41.711448 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:41.711959 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:41.712394 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:41.713079 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:41.713538 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:41.713960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:41.842981 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:41.850578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1dc8b831-cef3-496a-a174-63ead82ab6f3 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.150332 Oct 17 07:16:41.851140 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 640/1271] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:41 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:42.873448 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:42.874108 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:42.880960 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:42.881432 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:42.881859 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:42.882534 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:42.882977 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:42.883428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:43.010646 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:43.018878 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-45aebaf3-82c3-44d7-9154-070281182ac4 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.149288 Oct 17 07:16:43.019536 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 632/1272] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:42 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:44.041235 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:44.041813 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:44.048268 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:44.048747 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:44.049185 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:44.049870 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:44.050322 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:44.050740 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:44.180174 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:44.187845 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6fc9cae6-5510-4f38-8252-bf9e93f1cc46 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.150655 Oct 17 07:16:44.188401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 641/1273] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:44 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:45.211541 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:45.212157 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:45.214529 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell0:SELECT=2 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:45.220359 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:45.220845 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:45.221276 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:45.221962 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:45.222428 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:45.222839 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:45.354013 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:45.361657 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c0b6c616-d450-4c8b-970c-96265ef1c6a5 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.154022 Oct 17 07:16:45.362220 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 633/1274] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:45 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:45.854562 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6c3819b6-f4a4-48ae-9681-50fdbabd045b req-c866ade1-aa5a-4368-ae03-aa92ea9d8434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6", "name": "network-vif-plugged", "status": "completed", "tag": "6969833b-ce6c-437c-8a7e-9119cf23f8e6"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:16:45.861086 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:45.861900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:16:45.867578 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6c3819b6-f4a4-48ae-9681-50fdbabd045b req-c866ade1-aa5a-4368-ae03-aa92ea9d8434 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:45.868254 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6c3819b6-f4a4-48ae-9681-50fdbabd045b req-c866ade1-aa5a-4368-ae03-aa92ea9d8434 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:45.868690 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6c3819b6-f4a4-48ae-9681-50fdbabd045b req-c866ade1-aa5a-4368-ae03-aa92ea9d8434 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:45.880943 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6c3819b6-f4a4-48ae-9681-50fdbabd045b req-c866ade1-aa5a-4368-ae03-aa92ea9d8434 service nova] Creating event network-vif-plugged:6969833b-ce6c-437c-8a7e-9119cf23f8e6 for instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 on hv-cinder-84506 Oct 17 07:16:45.885911 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6c3819b6-f4a4-48ae-9681-50fdbabd045b req-c866ade1-aa5a-4368-ae03-aa92ea9d8434 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035358 Oct 17 07:16:45.886677 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 642/1275] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:16:46.388369 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:46.388903 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:46.395349 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:46.395821 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:46.396248 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:46.396920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:46.397365 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:46.397779 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:46.528501 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:46.536833 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-90e50737-3e73-4595-86bd-4e6f052d25aa tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1264 microversion: 2.1 time: 0.152346 Oct 17 07:16:46.537403 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 634/1276] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:46 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:47.560391 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:47.561220 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:47.569719 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:47.570204 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:47.570634 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:47.571358 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:47.571869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:47.572289 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:47.699960 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:47.707896 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5901b68c-992d-4a46-82c0-356e77c2209e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1451 microversion: 2.1 time: 0.151671 Oct 17 07:16:47.708452 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 643/1277] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:47 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:47.729534 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:16:47.730145 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:16:47.736897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:47.737371 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:47.737798 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:47.738475 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:47.738920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:47.739380 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:47.866425 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:16:47.874023 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-6a0f944b-1544-4c25-8687-3395ccf645a2 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1451 microversion: 2.1 time: 0.148295 Oct 17 07:16:47.874577 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 635/1278] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:16:47 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:16:49.416706 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-92c3b7d9-93b2-43ed-b332-4d6cb60ee5e3 req-734e411f-5de2-4899-a28f-0c622fc6f127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6", "tag": "6969833b-ce6c-437c-8a7e-9119cf23f8e6"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:16:49.426970 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-92c3b7d9-93b2-43ed-b332-4d6cb60ee5e3 req-734e411f-5de2-4899-a28f-0c622fc6f127 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:16:49.427473 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-92c3b7d9-93b2-43ed-b332-4d6cb60ee5e3 req-734e411f-5de2-4899-a28f-0c622fc6f127 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:16:49.427900 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-92c3b7d9-93b2-43ed-b332-4d6cb60ee5e3 req-734e411f-5de2-4899-a28f-0c622fc6f127 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:16:49.438530 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-92c3b7d9-93b2-43ed-b332-4d6cb60ee5e3 req-734e411f-5de2-4899-a28f-0c622fc6f127 service nova] Creating event network-changed:6969833b-ce6c-437c-8a7e-9119cf23f8e6 for instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 on hv-cinder-84506 Oct 17 07:16:49.443564 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-92c3b7d9-93b2-43ed-b332-4d6cb60ee5e3 req-734e411f-5de2-4899-a28f-0c622fc6f127 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030473 Oct 17 07:16:49.444297 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 644/1279] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:18:19.808949 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_api:SELECT=18 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:18:19.809704 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG dbcounter [-] [118996] Writing DB stats nova_cell1:SELECT=42 {{(pid=118996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:18:19.811019 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:18:19.811163 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Mon Oct 17 07:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 (ip 10.222.0.36) !!! Oct 17 07:18:19.812209 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:18:19.812325 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Mon Oct 17 07:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 (ip 10.222.0.36) !!! Oct 17 07:18:19.818016 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:19.819515 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:19.820701 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:18:19.821872 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=38 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 07:18:19.823495 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 07:18:19.823647 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Mon Oct 17 07:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 17 07:18:19.830081 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-0f124f2d-8095-4df1-85f8-43a5441e8475 req-cf17ee83-c7e9-4477-8da9-abc0ff7b4e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6", "tag": "6969833b-ce6c-437c-8a7e-9119cf23f8e6"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:18:19.830362 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:19.830964 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:19.831514 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:19.832287 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:19.832815 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:19.833300 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:19.843875 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0f124f2d-8095-4df1-85f8-43a5441e8475 req-cf17ee83-c7e9-4477-8da9-abc0ff7b4e29 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:19.844521 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0f124f2d-8095-4df1-85f8-43a5441e8475 req-cf17ee83-c7e9-4477-8da9-abc0ff7b4e29 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:19.844948 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0f124f2d-8095-4df1-85f8-43a5441e8475 req-cf17ee83-c7e9-4477-8da9-abc0ff7b4e29 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:19.858573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-0f124f2d-8095-4df1-85f8-43a5441e8475 req-cf17ee83-c7e9-4477-8da9-abc0ff7b4e29 service nova] Creating event network-changed:6969833b-ce6c-437c-8a7e-9119cf23f8e6 for instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 on hv-cinder-84506 Oct 17 07:18:19.864404 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:18:19.864893 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-0f124f2d-8095-4df1-85f8-43a5441e8475 req-cf17ee83-c7e9-4477-8da9-abc0ff7b4e29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048699 Oct 17 07:18:19.866565 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 645/1280] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:18:19.949174 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-5ae8b419-07b4-4fae-852c-42653d4d437b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 204 len: 0 microversion: 2.1 time: 0.141701 Oct 17 07:18:19.949963 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 636/1281] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:18:19 2022] DELETE /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:18:19.959497 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:19.960192 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:19.967037 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:19.967556 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:19.968000 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:19.968669 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:19.969114 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:19.969529 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:20.149315 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:20.157800 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-60633fc1-bc53-4dc4-83bc-666267161128 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1575 microversion: 2.1 time: 0.203437 Oct 17 07:18:20.158463 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 646/1282] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:19 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:18:21.183607 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:21.184439 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:21.190788 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:21.191295 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:21.191744 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:21.192463 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:21.192917 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:21.193339 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:21.435796 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:21.443518 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c6c3bd5a-028c-4ee3-9d45-2226375d3422 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1575 microversion: 2.1 time: 0.264783 Oct 17 07:18:21.444688 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 637/1283] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:21 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1575 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:18:22.469735 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:22.470367 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:22.477315 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:22.477852 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:22.478284 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:22.479610 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:22.480062 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:22.480182 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [req-c0e5116d-5f58-4bf2-be4d-ecd6354b5bab req-95db9dc8-fdaa-4ac7-8149-05e6c28a1c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6", "name": "network-vif-deleted", "tag": "6969833b-ce6c-437c-8a7e-9119cf23f8e6"}]} {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:18:22.480686 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:22.489691 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c0e5116d-5f58-4bf2-be4d-ecd6354b5bab req-95db9dc8-fdaa-4ac7-8149-05e6c28a1c79 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:22.490169 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c0e5116d-5f58-4bf2-be4d-ecd6354b5bab req-95db9dc8-fdaa-4ac7-8149-05e6c28a1c79 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:22.490597 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [req-c0e5116d-5f58-4bf2-be4d-ecd6354b5bab req-95db9dc8-fdaa-4ac7-8149-05e6c28a1c79 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:22.501538 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.compute.server_external_events [req-c0e5116d-5f58-4bf2-be4d-ecd6354b5bab req-95db9dc8-fdaa-4ac7-8149-05e6c28a1c79 service nova] Creating event network-vif-deleted:6969833b-ce6c-437c-8a7e-9119cf23f8e6 for instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 on hv-cinder-84506 Oct 17 07:18:22.506453 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [req-c0e5116d-5f58-4bf2-be4d-ecd6354b5bab req-95db9dc8-fdaa-4ac7-8149-05e6c28a1c79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030479 Oct 17 07:18:22.507835 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 638/1284] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:18:22.544042 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:22.551664 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cb15d562-5ebe-4f36-84b8-8f2965dc967c tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1389 microversion: 2.1 time: 0.087780 Oct 17 07:18:22.552222 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 647/1285] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:22 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:18:23.575282 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:23.576083 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:23.582484 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:23.582975 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:23.583434 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:23.584135 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:23.584590 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:23.585015 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:23.620834 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:23.621315 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:23.621778 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:23.622224 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.objects.instance [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lazy-loading 'fault' on Instance uuid e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 {{(pid=118996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 07:18:23.670302 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:23.678436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-938ca7cd-3847-4b84-a92f-4daacdd2918f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 200 len: 1228 microversion: 2.1 time: 0.108209 Oct 17 07:18:23.679150 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 639/1286] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:23 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 1228 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:18:24.709045 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:24.709650 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:24.716573 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:24.717049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:24.717479 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:24.718183 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:24.718631 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:24.719049 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:24.731783 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] HTTP exception thrown: Instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 could not be found. Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Request method failure captured: Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 HTTP/1.1 Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTQA5VRChkvroiC4URPsAxs-_jOouHQf_0rU0wNfG39ooKz8XUb1YfQpi18sP9pUR1WnVa6tKmvpVNfIH-CcN4XHB_DszgjC9ZAfY3vTDVpuJq6O6yv-n-zGuH0Ekw9SMDlQiGyXSZti_zgh_J6DsiJbaZJnVkdK62nWW8DkPe3abo2o Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:18:24.733381 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27c9c9c8efd64131b5944c5cf47553b3"}]}] Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 2dda9b6c5edd4dec87e4d23ecfcea5e9 Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 could not be found. Oct 17 07:18:24.735187 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': 'e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6'} Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 could not be found. Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:18:24.736303 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 could not be found. Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 could not be found. Oct 17 07:18:24.738091 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:24.739788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Returning 404 to user: Instance e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:18:24.739788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-094a7dd0-43aa-482c-91bd-807270561b2f tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6" status: 404 len: 111 microversion: 2.1 time: 0.029518 Oct 17 07:18:24.739788 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 648/1287] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:24 2022] GET /compute/v2.1/servers/e0ec9c4e-6ec7-4697-a8bb-cf4799008cc6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:18:27.800205 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:27.800712 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:27.807829 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:27.808308 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:27.808920 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:27.809792 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:27.810243 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:27.810661 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:27.838747 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Going to try to terminate instance {{(pid=118996) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 07:18:27.863146 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-833df186-9f67-461d-8d19-08fd4eb78095 req-478d3bba-a098-49bf-b1e1-1f837c3181b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d53856c-492c-4131-93b7-cf4a4f1fe317", "tag": "d70249d5-64f1-4af2-b4a5-bd513d30d8d3"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:18:27.872993 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-833df186-9f67-461d-8d19-08fd4eb78095 req-478d3bba-a098-49bf-b1e1-1f837c3181b3 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:27.873475 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-833df186-9f67-461d-8d19-08fd4eb78095 req-478d3bba-a098-49bf-b1e1-1f837c3181b3 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:27.873909 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-833df186-9f67-461d-8d19-08fd4eb78095 req-478d3bba-a098-49bf-b1e1-1f837c3181b3 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:27.886401 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-833df186-9f67-461d-8d19-08fd4eb78095 req-478d3bba-a098-49bf-b1e1-1f837c3181b3 service nova] Creating event network-changed:d70249d5-64f1-4af2-b4a5-bd513d30d8d3 for instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 on hv-cinder-84506 Oct 17 07:18:27.891726 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-833df186-9f67-461d-8d19-08fd4eb78095 req-478d3bba-a098-49bf-b1e1-1f837c3181b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092664 Oct 17 07:18:27.892312 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 649/1288] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:18:27.921864 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-88944963-9a0a-4ade-ac87-ae5c25d6f22b tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 204 len: 0 microversion: 2.1 time: 0.125152 Oct 17 07:18:27.922461 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 640/1289] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:18:27 2022] DELETE /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 07:18:27.932291 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:27.932991 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:27.939384 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:27.940131 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:27.940825 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:27.941737 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:27.942225 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:27.942620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:28.074577 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:28.083336 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c34f4c34-3846-42f0-b228-f5cf2964029e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1574 microversion: 2.1 time: 0.156316 Oct 17 07:18:28.084093 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 650/1290] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:27 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:18:29.107964 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:29.108699 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:29.114976 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:29.115492 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:29.115927 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:29.116738 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:29.117474 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:29.117907 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:29.262114 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:29.269897 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-59db6048-3854-4c92-812d-e301ca395799 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1574 microversion: 2.1 time: 0.166256 Oct 17 07:18:29.270468 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 641/1291] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:29 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 07:18:30.117620 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-328707dd-c81a-44d9-9330-3c579b04c0c7 req-f3461c7c-61bd-4a62-8a97-069545dd2a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d53856c-492c-4131-93b7-cf4a4f1fe317", "name": "network-vif-deleted", "tag": "d70249d5-64f1-4af2-b4a5-bd513d30d8d3"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 07:18:30.129182 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-328707dd-c81a-44d9-9330-3c579b04c0c7 req-f3461c7c-61bd-4a62-8a97-069545dd2a57 service nova] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:30.129659 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-328707dd-c81a-44d9-9330-3c579b04c0c7 req-f3461c7c-61bd-4a62-8a97-069545dd2a57 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:30.130089 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-328707dd-c81a-44d9-9330-3c579b04c0c7 req-f3461c7c-61bd-4a62-8a97-069545dd2a57 service nova] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:30.141412 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-328707dd-c81a-44d9-9330-3c579b04c0c7 req-f3461c7c-61bd-4a62-8a97-069545dd2a57 service nova] Creating event network-vif-deleted:d70249d5-64f1-4af2-b4a5-bd513d30d8d3 for instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 on hv-cinder-84506 Oct 17 07:18:30.146926 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-328707dd-c81a-44d9-9330-3c579b04c0c7 req-f3461c7c-61bd-4a62-8a97-069545dd2a57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Oct 17 07:18:30.147549 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 651/1292] 10.222.0.36 () {64 vars in 1317 bytes} [Mon Oct 17 07:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 07:18:30.294120 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:30.294727 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:30.301201 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:30.301769 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:30.302219 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:30.302893 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:30.303382 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:30.303799 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:30.366870 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.policy [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dda9b6c5edd4dec87e4d23ecfcea5e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c9c9c8efd64131b5944c5cf47553b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118996) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 07:18:30.374586 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-71ebf12c-7451-490b-a2ec-db8a969aad6e tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 200 len: 1222 microversion: 2.1 time: 0.084280 Oct 17 07:18:30.380820 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 642/1293] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:30 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 07:18:31.398869 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:31.399614 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 7d53856c-492c-4131-93b7-cf4a4f1fe317] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:31.405791 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:31.406210 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:31.406643 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:31.407354 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:31.407805 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:31.408226 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:31.421118 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] HTTP exception thrown: Instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 could not be found. Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Request method failure captured: Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 HTTP/1.1 Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTQA5VRChkvroiC4URPsAxs-_jOouHQf_0rU0wNfG39ooKz8XUb1YfQpi18sP9pUR1WnVa6tKmvpVNfIH-CcN4XHB_DszgjC9ZAfY3vTDVpuJq6O6yv-n-zGuH0Ekw9SMDlQiGyXSZti_zgh_J6DsiJbaZJnVkdK62nWW8DkPe3abo2o Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:18:31.422718 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27c9c9c8efd64131b5944c5cf47553b3"}]}] Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 2dda9b6c5edd4dec87e4d23ecfcea5e9 Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 could not be found. Oct 17 07:18:31.424502 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '7d53856c-492c-4131-93b7-cf4a4f1fe317'} Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 could not be found. Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:18:31.425356 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 could not be found. Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 could not be found. Oct 17 07:18:31.426728 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.428026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Returning 404 to user: Instance 7d53856c-492c-4131-93b7-cf4a4f1fe317 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:18:31.428026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-69956b79-702b-4c07-ae5e-76abc5d7e315 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317" status: 404 len: 111 microversion: 2.1 time: 0.030454 Oct 17 07:18:31.428026 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 652/1294] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:31 2022] GET /compute/v2.1/servers/7d53856c-492c-4131-93b7-cf4a4f1fe317 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:18:31.863919 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:31.864436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.compute.api [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118996) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:31.870995 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:31.871527 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:31.871954 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:31.872630 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:31.873073 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:31.873488 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG oslo_concurrency.lockutils [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:31.886926 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.wsgi [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] HTTP exception thrown: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Request method failure captured: Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: request: DELETE /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 HTTP/1.1 Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept: application/json Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Accept-Encoding: identity Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Connection: close Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Length: 0 Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Content-Type: application/json Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Host: 10.222.0.36 Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: Openstack-System-Scope: None Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: User-Agent: python-urllib3/1.26.12 Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Auth-Token: gAAAAABjTQA5VRChkvroiC4URPsAxs-_jOouHQf_0rU0wNfG39ooKz8XUb1YfQpi18sP9pUR1WnVa6tKmvpVNfIH-CcN4XHB_DszgjC9ZAfY3vTDVpuJq6O6yv-n-zGuH0Ekw9SMDlQiGyXSZti_zgh_J6DsiJbaZJnVkdK62nWW8DkPe3abo2o Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Id: None Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Domain-Name: None Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Identity-Status: Confirmed Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Is-Admin-Project: True Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Id: default Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Domain-Name: Default Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Project-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Role: member,reader Oct 17 07:18:31.888591 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Roles: member,reader Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27c9c9c8efd64131b5944c5cf47553b3"}]}] Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-Tenant-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Id: default Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Domain-Name: Default Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Id: 2dda9b6c5edd4dec87e4d23ecfcea5e9 Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: X-User-Name: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: method: > Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: exception: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.890435 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: action_args: {'id': '3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8'} Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:18:31.891436 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.893069 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.894687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Returning 404 to user: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. {{(pid=118996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:18:31.894687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-c16f3ccc-5385-4970-8c30-d84d621cf857 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 404 len: 111 microversion: 2.1 time: 0.030028 Oct 17 07:18:31.894687 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 643/1295] 10.222.0.36 () {58 vars in 1239 bytes} [Mon Oct 17 07:18:31 2022] DELETE /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:18:31.903196 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:31.903836 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] [instance: 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 07:18:31.909792 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:31.910271 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:31.910707 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:31.911419 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Acquiring lock "48e99de6-00ec-4832-bccb-b295fdd3a218" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 07:18:31.911876 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 07:18:31.912300 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Lock "48e99de6-00ec-4832-bccb-b295fdd3a218" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 07:18:31.925612 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] HTTP exception thrown: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Request method failure captured: Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 HTTP/1.1 Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Connection: close Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Host: 10.222.0.36 Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjTQA5VRChkvroiC4URPsAxs-_jOouHQf_0rU0wNfG39ooKz8XUb1YfQpi18sP9pUR1WnVa6tKmvpVNfIH-CcN4XHB_DszgjC9ZAfY3vTDVpuJq6O6yv-n-zGuH0Ekw9SMDlQiGyXSZti_zgh_J6DsiJbaZJnVkdK62nWW8DkPe3abo2o Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Role: member,reader Oct 17 07:18:31.927104 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Roles: member,reader Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27c9c9c8efd64131b5944c5cf47553b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27c9c9c8efd64131b5944c5cf47553b3"}]}] Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 27c9c9c8efd64131b5944c5cf47553b3 Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-386979739 Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Id: 2dda9b6c5edd4dec87e4d23ecfcea5e9 Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-386979739-project Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: method: > Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: exception: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.929359 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: action_args: {'id': '3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8'} Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 07:18:31.930323 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. Oct 17 07:18:31.931916 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 17 07:18:31.933306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Returning 404 to user: Instance 3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 07:18:31.933306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3a95d2cf-b3ab-407c-9bf6-fadda19a7863 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8" status: 404 len: 111 microversion: 2.1 time: 0.029144 Oct 17 07:18:31.933306 dv-cinder-845069-5-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 653/1296] 10.222.0.36 () {58 vars in 1236 bytes} [Mon Oct 17 07:18:31 2022] GET /compute/v2.1/servers/3a0430f2-060b-48c0-a2bb-cbe8adbbe2b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 07:18:33.218910 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: DEBUG nova.api.openstack.wsgi [None req-94b797b4-db78-48ae-95a3-f9f2df6ebcd6 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] Calling method '.version_select at 0x7f4ad0a30700>' {{(pid=118996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 07:18:33.243553 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: INFO nova.api.openstack.requestlog [None req-94b797b4-db78-48ae-95a3-f9f2df6ebcd6 tempest-TestVolumeBootPattern-386979739 tempest-TestVolumeBootPattern-386979739-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-3037217" status: 202 len: 0 microversion: 2.1 time: 0.028187 Oct 17 07:18:33.244593 dv-cinder-845069-5-iscsi devstack@n-api.service[118996]: [pid: 118996|app: 0|req: 644/1297] 10.222.0.36 () {58 vars in 1254 bytes} [Mon Oct 17 07:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-3037217 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)